It's not rude. But no one wants to hear your conversation so if it's going to be loud then defer it. I think a quick and quiet 'Hi, sorry I'm on the train at the moment, I'll give you a call back' is perfectly acceptable. All phone calls are acceptable, just don't tell the whole carriage.