Like most wealthy gentlemen of his day, Charles Carroll of Carrollton owned multiple houses, including one in Annapolis. But the one that he preferred was Doughoregan Manor, the home believed to have been built by his father Charles Carroll II around 1727. It started as a one-and-a-half story brick house with a gambrel roof and two sizable outbuildings, a kitchen and a family chapel. Charles Carroll V enlarged it in the 1830s, giving it the Greek Revival appearance it maintains today. The house and the estate surrounding it are still owned and occupied by members of the Carroll family. Supposedly a Carroll family member observed that, “only God, the Indians and the Carrolls have owned this land.”