Mass doesn't affect speed directly. It determines how quickly an object can change speed (accelerate) under the action of a given force. Lighter objects need less time to change speed by a given amount under a given force.