The PSP has no button labeled with a music symbol on most models. The exception: the original PSP-1000 has a Note button (music note icon) on the lower left face. It launches the Music player from any screen.
If you saw a music note button, it's a launch-model PSP-1000. Later models replaced it with Screen.