Besides misaligned expectations, banking on a vacation to be the ultimate solve or escape for something you don't feel good about already—whether it's your mood or a situation at home, relationships with loved ones, or work—can contribute to vacation guilt, says Dr. Norris.