Comparing and S8 and S4 might be some of the issue. How old is yours? Even the newer BMW's seem to be going that way. The e60 BMW's felt like they were made of more substantial material. Perhaps that is why they weighed 500lbs more then the next car.

The S4 is much more a drivers car which is what I am aiming for. I just have to get some of the old man out of me. You know I was looking at Caddy CTS-V! I just did some more research since I don't know much about Audi's and apparently there is some well needed options if you really want to get the most out of an S4. From automobile mag:
If you're keen to get the best S4 drive experience possible, the $1,100 optional sport differential with Audi Drive Select is a must-have addition to the $48,000 Premium Plus trim car you see here. If you have no intention of going for this option, there's really no spectacularly convincing reason to buy the S4 unless you're addicted to having at least six cylinders under the hood.
Reading this and then seeing the car doesn't come with it leads to more questions. I know you have to draw the line somewhere, but if you ordered this car, wouldn't you get it? Today was my day off. I need to go back to work and do something productive.