But you do need to understand that no matter how much money you make, a vacation is not a want, it's a need. A good rule of thumb, especially for middle-income families and those of even more modest means, is that you should spend about 8% of your annual income on leisure travel. Call it the 8% rule.