European Castle History: Who built the first castles? The first castles were probably constructed in Europe in the 800s. However, from the 10th century onwards, it was the Normans who started to build castles with particular vigour. The Normans hailed – unsurprisingly enough – from Normandy in France.