He might keep Pat, perhaps.
Even the dogs would go with Nelly.
He would never have his girl any more.
The Dowager would be always there.
The Dowager would know better than anyone how to set up an invisible barrier between Nelly and her father.