It is swimsuit/shorts weather all year in the Caribbean. Of course, you can encounter a rainy day but it is never Cold. Water temp can vary by currents/storms but for most people who don't need the water to be 85 degrees and up :D, swimming is almost always reasonably possible.