PSP plugins aren't standalone apps you toggle—they're firmware-level modifications loaded at boot via configuration files. Disabling requires file editing or CFW tools.
PSP modding is mature but unforgiving. When in doubt, seek expert guidance or accept the plugin's presence.