I can't imagine WD-40 being the best thing to clean out the brasso, but I can't imagine it would gum up the action either. In my experience, the only times I would advise not using WD-40 is if it would strip out any grease (as it contains some variety of mineral spirits) that you want in the mechanism.
From what I have read some people say that WD-40 is great to clean your firearms, other give a strong warning to stay away from it. I kinda fall in between, use it if you want, I seriously doubt it will harm anything, but make sure you let the WD-40 completely dry and use a good lubricant afterwards.
WD-40 does have some slight lubricating properties to it and works great on squeaky hinges or a rusty bicycle chain. But I would not trust it to protect my firearms from the heavy friction involved in the firing action. In
WD-40's website under their faq they say it is safe for use on firearms. This may be true, but I want a good CLP designed specifically for firearms. I don't think you have done anything terrible by using WD-40. I honestly would be more worried about getting the rest of that brasso out.
WD-40 does have many uses. I use in on plastic flairs and in the wheel wells on my jeep to keep mud from sticking to them.