Water temperatures in the Caribbean can be cool in January and February, depending on how exposed your destination is to the chilly waters of the open Atlantic. The occasional winter storm and breezy conditions can make waters a bit rougher in January and February as well.