Yes, the PlayStation 2 was designed for both vertical and horizontal placement. Specific instructions are in the PS2 user manual.
However, note:
Ultimately, the choice is yours. Use a proper stand for vertical placement and consider overheating risks.