You can delete games directly on the PSP Go. The original answer claiming otherwise is incorrect. The PSP Go uses 16 GB internal flash (`ef0:`) instead of a Memory Stick, but the XMB interface supports deletion natively.
TL;DR: Triangle → Delete on the Game menu. Works exactly like PSP 1000–3000.