In his book there is a record of this visit of mine.

He was standing silently by the wall.
"I've come to take you to lunch," I said to Oscar.
"But he cannot go out," cried Willie.
"Of course he can," I insisted, "I've come to take him." "But where to ?" asked Willie.
"Yes, Frank, where to ?" repeated Oscar meekly.
"Anywhere you like," I said, "the Savoy if you like, the Cafe Royal for choice." "Oh, Frank, I dare not," cried Oscar.
"No, no," cried Willie, "there would be a scandal; someone'll insult him and it would do harm; set people's backs up." "Oh, Frank, I dare not," echoed Oscar.
"No one will insult him.

There will be no scandal," I replied, "and it will do good." "But what will people say ?" cried Willie.
"No one ever knows what people will say," I retorted, "and people always speak best of those who don't care a damn what they do say." "Oh, Frank, I could not go to a place like the Savoy where I am well known," objected Oscar.
"All right," I agreed, "you shall go where you like.

All London is before us.

I must have a talk with you, and it will do you good to get out into the air, and sun yourself and feel the wind in your face.
Come, there's a hansom at the door." It was not long before I had conquered his objections and Willie's absurdities and taken him with me.