In the South he was regarded as an "abolitionist," the most horrible of all monsters; and many people of Louisiana looked at me with suspicion, as the brother of the abolitionist, John Sherman, and doubted the propriety of having me at the head of an important State institution.

By this time I was pretty well acquainted with many of their prominent men, was generally esteemed by all in authority, and by the people of Rapides Parish especially, who saw that I was devoted to my particular business, and that I gave no heed to the political excitement of the day.

But the members of the State Senate and House did not know me so well, and it was natural that they should be suspicions of a Northern man, and the brother of him who was the "abolition" candidate for Speaker of the House.
One evening, at a large dinner-party at Governor Moore's, at which were present several members of the Louisiana Legislature, Taylor, Bragg, and the Attorney-General Hyams, after the ladies had left the table, I noticed at Governor Moore's end quite a lively discussion going on, in which my name was frequently used; at length the Governor called to me, saying: "Colonel Sherman, you can readily understand that, with your brother the abolitionist candidate for Speaker, some of our people wonder that you should be here at the head of an important State institution.

Now, you are at my table, and I assure you of my confidence.

Won't you speak your mind freely on this question of slavery, that so agitates the land?
You are under my roof, and, whatever you say, you have my protection." I answered: "Governor Moors, you mistake in calling my brother, John Sherman, an abolitionist.