Once I got my rear sight where I wanted it, I put removed the set screw, put a drop of blue Loctite in the hole and stirred around with a toothpick to remove the air bubble.
I then reinstalled the set screw hoping it would push the Loctite down under the base of the sight. It should help lock everything in place.