Perhaps try knocking the pins out of the front frame insert and raising the slide enough to get to the slide lock spring or whatever else may be in the way? I know you can't remove everything without getting the take down lever out, but maybe you can get enough clearance to free it up?
Joe