Yes, some onsen allow you to wear a towel into the baths, while others forbid them. Some onsen also allow (and even require) swimsuits to be worn. People generally bring a small towel with them to the baths either way. As long as you're not breaking any rules, you should do what you're comfortable with.