The universal symbol for this is to put headphones on and to pretend you don't hear your driver. But a more courteous way is to simply tell the driver there is something else you need to do. As in, “I'm sorry, I don't mean to be rude, but I've got some work I need to focus on right now.”