No, you do not need an internet connection to play many Xbox One games offline.
Settings → General → Network Settings → Go Offline. Console won't attempt connection. To reconnect: same menu → Go Online.
Bottom Line: Disc-based single-player = fully offline after initial update. Digital = offline only on Home Xbox. Online features need live connection + subscription.