It is definitely possible to travel to France while only speaking English. Especially in the more tourist oriented areas, it really is not a problem to only speak English. While France has less English speakers than other European countries, it was still relatively easy to manage.