The IRS will consider a vacation home either a residence or a rental property based on how many days it is used as a rental vs. personal. Rental income from vacation homes rented less than 15 days during the year doesn't need to be reported on tax forms.