They were flying around at 80000 feet at some point in their mission profile. Basically you have to get above most of the atmosphere. So you should start to see stars above 43000 feet. Of course there are some other options, you see them during an eclipse or above the Arctic circles in the right season.