Actually, scratch what I said earlier. If you have the hbi hand guard, that doesn’t use the barrel sleeve. Whoever sold you your Bren just stuck that piece in there for whatever reason. The barrel sleeve(s) are integral to the stock Bren 2MS, which has @14 torqued screws in its “hand guard” configuration, but that’s another can of worms…
I think your issue is probably the torque on your 4 remaining mounting screws on the hbi hand guard. The two barrel sleeves, which are integral to the stock “hand guard” come off with the lower rail removal. Problem is, I don’t think hbi has a set torque value for those 4 remaining screws that hold it all together. Initially they advised 90 in.lbs. (as opposed to 64 in.lbs. as advised by CZ in its stock configuration) but then people literally started getting their extruded receivers pinched, which actually interferes with the action. I’ve seen various “interweb recommendations” of anywhere from 20 to 40 to 90 in.lbs., which is crazy.
I had chamber blowback when I used the hbi hand-guard (thick black streaks of powder on spent cases), which I attributed to some headspace interference. So I went back to the original 14 screw MS configuration, much as I hate it ergonomically. But at least it functions properly.
Of course, the Bren 2 to have is the original “military” S model which had no hand guard contrivance at all - just an extended receiver with M Lok slots. Of course, those few S models are long gone, no longer available in the US market, for whatever stupid reason CZ came up with.
Anyway, I think the torque on your 4 remaining barrel / receiver / hand guard screws is likely your accuracy issue…good luck!!!