I haven't had this happen to me but yeah, I'd be concerned about it. You can drive the pin out and look at it. My guess is it needs to be replaced. CGW sells a hardened pin. I'd sure look at the FP and spring, too. Whichever pin gets put back in the slide, the notch goes up.
BTW welcome to the site. Easily the friendliest and most helpful forum I've ever seen.