Can you waive the Amex Gold's annual fee? Unfortunately, the American Express® Gold Card's annual fee is something that normally can't be waived. However, if you're considering downgrading or canceling your card, you can try calling Amex customer service and asking for a retention offer.