Personally, we still prefer at least four day (five night) trips even if we aren't personally set on any rides without our toddler. This allows more flexibility and time for things like the pool at the resort, shopping around Epcot's World Showcase, or sleeping in one morning.