This brings us to the question of who owned the castles? The castles can generally be split into several categories, royal and baronial either being built and owned by the king or built by a baron with or sometimes without the permission of the king.