Use lines like this instead.
- I'm still a bit too nervous to travel right now, but I totally understand your desire to get away.
- I 100% wish I was as comfortable as you are to travel right now, but I honestly just need some more time.
- I'm so sorry, but I still have anxiety about being in an airport or on a crowed flight.