Directly saying no to a drink, in general, could be seen as rude. However, Koreans will understand if you don't drink for medical or religious reasons. If you really don't want to drink, it's best to politely say 'no'. You might suggest saying that you are on some medication that doesn't allow you to drink alcohol.