I've got the K&M tool, too. There are 0.062" and 0.080" versions. The 0.080" version won't even fit the extra-small flash hole brass, such as Lapua.
I don't debur Lappy brass – it's drilled and smooth as a baby's bum. But for Starline, ADI and other punched brass, it does clean up quite a lot. I don't know how much difference it makes, but it feels good doing it
ADI/OSA brass is interesting because most headstamps have the larger flash holes (0.080") but some (especially earlier brass) have the smaller flash hole.
Perhaps that is the issue you are having? If so, I'd say it's perfectly OK to enlarge the smaller flash holes to the larger size to uniform your brass.
EDIT: OK, I've just found some data I compiled on ADI brass for anyone interested:
ADI head stamp = 69gr SMK (hollow point)
Small flash holes, light brass (around 91.5gr +/- 0.5gr on average)
OSA small head stamp = 55gr BK (plastic tip)
Large flash holes, light brass (around 91.5gr +/- 0.5gr on average)
OSA large head stamp = 55gr GK (soft point)
Large flash holes, heavy brass (around 93.5gr +/- 0.5gr on average)
The laws of physics do not apply to politics.