The Carleton House is a 2+1⁄2-story wood-frame structure, with a gable roof, two interior chimneys near the side walls, and a granite foundation. The main facade, facing south, is five bays wide, with a central entry that has flanking sidelight windows, and a Federal-style surround that has pilasters supported in an entablature with cornice. The windows are uniformly 12-over-12 sash. A single-story ell, probably an early addition, extends to the north. The interior has a central hall plan, with two rooms on each side of the hall on both floors. These rooms have original Federal period woodwork, including fireplace mantels, wainscoting, trim, and doors.[2]
The town of Sangerville was first settled c. 1801–02, and Thomas Prince, one of the early arrivals, established a fulling mill on what is now called Carleton Stream, which empties into the nearby Piscataquis River. One of Prince's workers, Guy Carleton, purchased the land on which this house stands in 1818. The following year he sold it to his brother Robert, who built the house. Robert was a prominent member of the local militia, seeing some heightened activity during the border dispute with neighboring New Brunswick known as the Aroostook War. Guy Carleton established his own mill, which survived as a business into the 20th century.[2]