Unless you're with close friends on a casual event, it's usually considered rude to leave the table before the meal ends. Of course, if you have a reasonable excuse to do so, nobody will throw rocks at you, but it's generally better not to be in a rush. Santé !