A.C. Freeman built this house in 1903, originally on land he purchased from Albert Gilchrist, after migrating to Punta Gorda in 1889. Freeman owned a hardware store and a citrus grove, among other ventures. He served in various city government positions from 1896 to 1904, including tax collector, councilman and treasurer as well as mayor during the later four or five years. He was the first elected mayor in 1900 and served as the sheriff of DeSoto County (from which Charlotte County was derived) for eight years. During the 1902 mayoral campaign he was described as "'Industrious, frugal and obliging... well-to-do, but probably not a millionaire'".
The house is currently owned by the City of Punta Gorda. In 1985 it was slated for demolition. A major community effort coordinated by the Medical Center Foundation relocated the house from its original East Marion address, where Kays Ponger Funeral home is today, to 639 Hargreaves Street. Ultimately, the house was relocated to its current location on Retta Esplanade and 41 South, serving as a familiar gateway into the city. The City assumed ownership of the building after Hurricane Charley struck in August 13, 2004. It was then moved to its present location.