The PS2 controller (DualShock 2) doesn't have buttons labeled "back." You're likely referring to the L1 and L2 buttons on the left shoulder.
Functions vary by game; check the in-game control menu or manual for specifics.