The only one I've attempted to swap is putting a DUTY 9MM P07 slide on a DUTY .40 S&W frame. Worked fine, no issues.
It may be that there are slight differences in some slides/frames and when they build them at the factory they have to do some additional clearance work (filing/stoning/polishing) to get a slide and frame to fit/work together. Maybe one or the other is "off" just slightly and they make them fit/work. If so, who knows which piece the modify, the slide or the frame? Which is quickest/easiest? If this occurs and either frame or slide is swapped another frame/slide later there might be similar clearance issues.
Didn't CZ make some pistols with full length slides on Compact frames? Or was it Compact slides on full sized frames? But even so, they'd have made sure the parts fit/worked at the factory before shipping them.