Yes, you can "jailbreak" a GBA, but it means something different than on phones: running homebrew, playing ROM backups, or modifying firmware via flash cartridges.
These plug into the GBA slot; load ROMs/homebrew from microSD. No console modification needed.
Flash carts are the recommended route. Research thoroughly before modifying hardware.