If the credit card account you plan to close is one of your oldest accounts, it will reduce the average age of your remaining accounts when it is removed from your credit report. This would potentially lower your credit score, though usually not dramatically.