Though trips for retirees are indeed common—with at least 25 percent of those 65 and older leaving the country annually—sometimes, finances play a factor. That's why it's smart to not only start thinking about where you'll go when you travel in retirement but also how you'll pay for it.