CGW sells a "starter" punch that is hardened. Just for getting those stubborn pins "started" moving out of the hammer (or other places where they're severely stuck in place.) Get it moving (sort of looks like a center punch, so it should be pretty tough vs. the standard skinny shafted punches of varying diameters/lengths) and then switch to the standard punch to finish removing it.
My youngest son has a CZ75 SA. We go to the range and I can hardly get him to shoot the P07 he carries. He just keeps shooting the SA because, "But dad, I just get a kick out of shooting small groups."
I've not yet had trouble getting those pins out. I did have trouble getting one back in. Got close, just mushroomed the end I was pressing/pounding and finally gave up and filed/stoned the remaining end flat with the side of the hammer.