Dominica. Often confused with the Dominican Republic, Dominica is rated as one of the best places to retire in the Caribbean. Not only is the mountainous Caribbean island nation safe to live in, but it also offers a relatively low cost of living, tax advantages, as well as modest healthcare.