The PSP does not natively support proxy server configuration in its system network settings. You cannot simply enter a proxy IP/port like on a PC or phone.
If you need proxy access for Store downloads (historical), router-level is the most stable method. For everything else, direct connection is best.