What driver do you have ?
Most important is what degree is the face?
To many high handicap players dont have enough loft on the driver.
As we get older its a good idea to add some loft.
I would recomend something with 12 or 13 deg loft.
Can you tell me what shaft you have on your driver?
It sounds like it may be to stiff.
Get the right driver in your hand first.
Oh, and what ball do you use?