In class E airspace, IFR aircraft are controlled by ATC. This might be a center facility (Air Route Traffic Control Center) or approach/departure facility. As a VFR aircraft, you aren't required to be in contact with ATC, but IFR aircraft must operate on an ATC clearance. That means the airspace is controlled.