Depending on the air temperature trends, the water will cool down or warm up in a matter of days. Of course, the water temperatures on the offshore reefs are not as drastic. If you are traveling to the Bahamas during the winter months, you can expect the water temperatures to be around 74 degrees Fahrenheit.