Mine loosened up, but it's still in the dovetail - I simply tightened up the set screw.
If yours came loose and came off the slide, check that you can fully remove the set screw and that you can screw it into the rear sight enough to protrude through the bottom. If all looks normal, you can apply a thin coating of blue loctite on the set screw thread before setting it in place.
Sent from my iPhone using Tapatalk