No, you do not need an internet connection to play Minecraft on Xbox. The game supports full offline single-player gameplay on Xbox One, Xbox Series X|S, and Xbox 360 Edition.
Simply launch Minecraft without signing into Xbox Live, or if prompted, choose "Play Offline." Your worlds save locally to the console. Note that initial download and updates require internet, but after that, solo and local co-op play are fully offline.