Noise doesn't bother me so much but chaotic, cacophonous noises do. I've never liked clutter, disorganization, large crowds or messiness so it's probably related to that somehow - auditory clutter if you will. Still, a good bit of well-performed music played at high volume still inspires me and gets the blood going... I just don't like "messy" music / sounds at any volume.
If that makes me a "grumpy old white guy" then so be it. Now get off my lawn.