Perhaps the little man was annoyed because of his challenge to the village crowd?
Well, be it so.

He meant, and would live up to, every word of it! The afternoon dragged after the pressman's departure.

What Grant really hungered for was a heart-to-heart talk between Doris Martin and himself.
But, short of a foolish attempt to carry the post office by storm, he saw no means of realizing his desire.

He must, perforce, await the less troubled hours of the morrow or next day.

Doris would surely give her father an exact account of the conversation between Grant, Furneaux, and herself that morning, and that greatly perplexed man could hardly fail to see how unjust was the tittle-tattle of the village.
So, avoiding Mrs.Bates, whose fell intent it was to ask him what he wanted for dinner, he struck off along the road to Knoleworth, walked eight miles in two hours, and reached The Hollies about seven o'clock, rather inclined for a meal and much more contented with life.
Minnie announced that a gentleman "who brought a bag" had been awaiting him since half-past five, and was now asleep on the lawn! A glance at the aforesaid bag, still reposing in the entrance hall, sent Grant quickly into the garden.