I don't know how it could have happened, but could the front sight slot actually be off center, like maybe the slide was not mounted correctly in a jig during manufacturing? I believe you said you installed two different kinds of rear sights-if so-then that should eliminate an improperly manufactured rear sight.