Center punching the holes is generally the best way to do it. And possibly use a smaller pilot bit.
They also sell self-centering drill bits that would work well for you.