Throwing this out there, but this weekend I borrowed the VISM rear sight tool from a friend to install a LPA adjustable sight on a 75B. Didn't expect much out of a $60 tool. I was wrong. Worked like a champ.
I do not have any experience with "universal-type" sight pushers, only with weapon specific ones for Glock and Sig, but I would recommend the VISM for your kit, particularly for occasional use.
You still need to take reasonable care to properly hone/fit the sight and squaring the slide in the tool, but one heck of a lot easier than drifting with a hammer/punch. Was able to get the sight centered to .001".
For rear sight removal, I started with the hammer, mainly because I did not want to damage a borrowed tool. I don't think it would matter. I'll be buying one.