Well, I don't know about w/out opening the PSP. But you can try this. Take off all the screws except the one that is under the black label thing. (which is the screw located in the battery slot) And then try to shake it around to get it to break free. Then put all the screws back on. This is so that way you don't void the warrenty.

Or you can try to put something small enough to fit into the slot and make sure it is tough enough to resistance, then move it around until it releases the part.
