A credit card can be canceled without harming your credit score?. To avoid damage to your credit score, paying down credit card balances first (not just the one you're canceling) is key. Closing a charge card won't affect your credit history (history is a factor in your overall credit score).