I solved my drill press issue/mill issue. Use the lathe! I just have to center the knob, easy to do with a slightly smaller bit than the original hole. Once centered, cinch it up in the jam chuck with a hose clamp, spin up the lathe and extend the drill bit into the knob. The larger hole is as centered as can be.