I've had pretty good luck with my local bank, First Tennessee. If there are small local banks, try them. It's not like you're born to use only one bank. The other alternative is a mattress. It costs you nothing to make withdrawals or deposits.
I enjoyed a more simple and happy life when I stopped sweating the small stuff. If the problem is big enough to fret over, then fix the problem. Don't let the problem continue...