Over time if earplugs are used each night, they can push your ear wax far up into your ear, and cause temporary hearing loss. To remove the built up wax, either drops can be used, or you may even have to get the wax removed by a doctor. Not only can wax buildup be an issue, but ear infections can happen with earplugs.