Now known as the Ayer Mansion, the now single-family home has 23 bedrooms and 12 baths throughout its five stories, and also features rooftop panoramic views of Back Bay and the Boston skyline.