Presidential portraits line the walls of this storied private club, where members and their guests enjoy refined dining and impeccable service in a setting steeped in New York history.