This is the deburrer I bought a few years back. It was recommended as it comes with a few different cutting edges, but you .
It works well. The heads on these swivel, so they shave instead of gouge.
It's a replacement tool for a router and countersink drill bit. Knocks off hard edges and can easily make room for a screw head.
Edit: Here, see it in action.
I use this one but there are even cheaper models if you don't care about getting the extra bits.
You could try a deburring tool. Or if you're feeling really bold, try flaming the edge with a torch. Or just some good old fashioned fine sandpaper.