In 1837 a building on Broadway near Leonard Street was secured, and the club moved into it, there to remain for three years.

Then, for seven years, it was in a house on the other side of Broadway, and in 1847, obeying the prevalent impulse up-townward, it shifted its quarters to the spot from which it was later to remove to the Twenty-first Street home.

That structure at Broadway and Fourth Street was the property of the Stuyvesant family, and after the departure of the men of the Union, was occupied by the confectioner Maillard as a hotel and restaurant.

In 1852 the question of a permanent building began to be discussed, and in 1854 the land at the Twenty-first Street corner was secured and the work of erecting the structure that in its day was the most imposing of all that lined Fifth Avenue between Waverly Place and the Broadway junction begun.

The club moved into the new quarters in May, 1855, at a time when its membership numbered approximately five hundred.