As said, unless you are BA staff, there are no rules on what you wear. I always wear something comfy with elasticated or adjustable waistband. You will get a duvet like blanket thingy on the flight to keep you warm, and under that, nobody will be able to see what you are wearing. Enjoy your flight.