What Operating System Does the PS3 Use? (Cell OS, GameOS, and OtherOS Explained)
The PS3 runs a proprietary hypervisor-based OS stack, not a general-purpose OS like Windows or Linux.
The Stack
Cell OS Lv-0 / Lv-1 (Hypervisor): Bare-metal firmware on Cell BE. Manages hardware partitioning, security, isolation. Closed source.
Cell OS Lv-2 (Game OS / "GameOS"): The OS games run on. Provides libraries (libgcm, libaudio, libfs, libnet, etc.). Custom kernel, POSIX-like APIs. Not Linux, not FreeBSD. Shares some BSD-licensed code (network stack, file systems) but is a distinct kernel.
XMB (Cross Media Bar): The shell/UI process running on GameOS.
Clarifying "OtherOS" & FreeBSD
OtherOS: A hypervisor feature (Lv-1) allowing installation of a second OS (Linux: Yellow Dog, Fedora, Ubuntu, Gentoo) in an isolated partition (SPEs 6–7, 256MB RAM, no RSX GPU access). Removed in Firmware 3.21 (April 2010) due to security exploits (Geohot).
FreeBSD Code: Sony used BSD-licensed components (TCP/IP stack, UFS2, pthreads, libc parts) in GameOS. GameOS is not FreeBSD. It is a custom microkernel-style OS.
Summary
Native Game OS: Proprietary "Cell OS Lv-2" (GameOS).
Linux: Only via deprecated OtherOS (Fat PS3, FW ≤ 3.15).
FreeBSD: Source of some libraries, not the OS itself.