Hearthstone Castle This medieval style castle was built by E. Starr Sanford in 1897 in Danbury Connecticut. It was called Hearthstone Castle due to the many stone fireplaces it contains. Although Sanford built the castle to use as a summer home, he and his family only lived there 5 years.