I have two P-07's with majority of CGW parts, both stock trigger pins polished on 2000 grit sandpaper with a dremel as per the guides on this forum, a few thousand rounds through each pistol, no problem with the pins.
I think I read here about a guy who actually had the trigger, not the pin, break on him while shooting, after installing the CGW trigger return spring.
I would say that when you are re-inserting the trigger pin into the frame, using a slave pin to hold the spring in place and pushing that slave pin out of the way, and then getting the trigger pin back in place... you shouldn't force it or bang on it. It can all be done with minimal force, using finger pressure and a punch, when everything is lined up correctly. Sometimes it hangs, and you need to re-align it, but I would avoid tapping it with a hammer when that happens. It can be helpful to use a second punch inserted on the opposite side to keep things aligned, after the slave pin is out, but before the trigger pin is fully back into proper position. Basically you want to use some finesse and not beat up your pin, trigger, or frame during the process of re-installation.
Firing with no magazine in the gun shouldn't be a problem, but chambering a round by dropping it in through the ejection port can break your extractor, as mentioned previously. The rim of the shell casing is meant to slide in behind the extractor, not be pushed into the front of it.