It is absolutely safe to go off resort in St. Lucia. Just use common sense as you would at home: don't go into dark alleys late at night, etc. The Sandals bus only goes between the 3 resorts, to go to the town you will need a taxi (or a couple of miles walk, depending which Sandals).