For me, the hardest was the Instrument Rating. Going through the private pilot training, everything was new; communications with ATC, learning the aerodynamics, etc. With the instrument rating, the phraseology with ATC is completely different. There is a lot more activity occuring in the cockpit.