Yeah, HBI is definitely the way to go.
By press fit, I just meant that I made it so it takes some effort to put it on and take it off. I drilled the small hole for the retaining screw also. No slipping off and no movement caused by loose fit.
Being plastic, I didnt want it to have ANY movement of the base which would cause it to wear. By making it tight, it shouldnt wear out before I either make one out of aluminum, or get an HBI.
To remove, I have to remove the screw and then twist it while pulling.