I would try 600 grit sandpaper and follow up with 800 or 1000 grit to polish. Wrap the sandpaper around some popsicle stick that is cut to fit that surface...
Since you might just need to polish out a bit at a time. P.S use one way sweeps not back and forth. A bit at a time.
Takes patience !!
A right sized flat file may work but you need to be sure you don't go too aggressive. Files come in various grades...med,fine etc..
Since pistols are all quite individual, what one person has to do is not what another person needs to do...
dremel might be too aggressive!!
Who knows,your disco might drop in...
good luck!!