There's a greater risk of collision with terrain or obstacles like radio towers, especially if your aircraft is a fast one and you have less time to react. The likelihood of both thermal and mechanical turbulence is higher when flying low, increasing risks of loss of control and collision with terrain and obstacles.