Yes, absolutely. Game audio routes to your headset regardless of whether you're signed into Xbox Live. The console outputs sound through HDMI, optical audio, or the controller's 3.5mm jack, and any headset plugged into the controller will receive game sound automatically—no Xbox Live sign-in required.
You'll hear the game perfectly; you just can't talk to anyone online.