How tight the slide to frame is is something for 1911 owners to brag about to one another, but it has very little to do with a gun's mechanical accuracy because you don't aim with the frame. The two places this is not true are when you're shooting from a gun-vise, in which case you literally are aiming from the frame, or when you're using optical sights that are mounted to the frame instead of the slide.
Remember that at the time the bullet leaves the barrel, the barrel/slide is either still locked or just starting to move. And even if that weren't the case, so long as your sights are mounted to the slide, it's the relationship between the barrel and slide that determine how consistently your point of impact is vs your point of aim, not the relationship between your slide and frame.
Most of an auto-loader's accuracy has to do with how tightly and (more importantly) consistently the barrel locks into the slide. Disassemble the gun and check to see if the barrel while locked in has any play in it at either the locking point or at the muzzle. If so, that's most likely the main problem, and unfortunately, I don't know what you can do about it other than get another barrel and hope it fits better. An actual gunsmith, which I am not, might be able to advise you better there, but I'm not sure what can be done, if anything, with a sloppy barrel. One other possibility is that you have a generally crappy barrel, or that your barrel's bore is dramatically over-sized, and normally sized 9mm bullets, particularly jacketed ones, just aren't big enough to function well in it. Have you tried shooting lead?
