To remove that left side safety and file, or stone, on the cam on the safety shaft you don't remove/loosen and springs. You do have to raise that one spring arm up (on the sear spring) to get it out of the slot in the safety shaft so you can remove the safety, but the spring is retained in the sear cage by the pin in the cage (that you don't remove just to get the safety out).
I stoned on the top of the cam to fit my safety into my Compact - but maybe only because I also replaced the hammer. It may not have been the same job had I just replaced the safety.
And there's always that option of installing the CGW adjustable sear, which makes for no fitting at all. But you do have to take the sear cage apart to install the adjustable sear.