Route game audio through your headset (not TV) via:
Audio Settings: Xbox Settings → Audio → choose game/chat/both routing.
Pick based on audio quality, comfort, wired vs. wireless preference.