Probably not, but there's a way they can know. Drivers are shown their average of the last 100 ratings, so unless they were paying close attention, it is possible your rating was averaged together and not noticed by the driver. I think this is the point of the average, and the reason Lyft has the app set up this way.