I hate to admit it, but I'm the same way. I can feel the effects of even just one beer the next day... I think I may have some sort of allergy or gastrointestinal aversion to it.
It's not that I don't like to drink or the effect of alcohol, but the Pavlovian conditioning of feeling like hell the next day keeps me away from partaking very often. If I decide to drink though, I may as well go "all out" as the after effects are the same no matter the quantity!