You cannot call a phone number to remove a card. Do it yourself:
Important: If the card pays for an active subscription (Game Pass Core/Ultimate, EA Play), you must cancel the subscription first (or switch payment method) before removal.
If removal fails: Contact Xbox Support → Chat/Callback. Have account email and order history ready.