[masraum]

As has been stated, using a larger diameter bits get harder and harder to do in handheld drills. Ideally, you'd have some sort of jig or press that could be used. The issue is that if the angle of the drill/bit ever changes, then things can get dicey really quickly. going from 1/8" -> 1" -> 3" -> 6" each jump is huge. And it sucks no matter what, whether it's a hole saw, paddle bit, or Forstner bit.

Take it slow, be careful, use a more powerful drill that's got better/more holding options (side handles and the like).

And yeah, I know a guy that broke his wrist using a drill that caught and twisted his hand around.