Back on topic, I hold the door if someone is nearby...however I judge that at the time. Or possibly if they're holding a package or pushing someone in a wheelchair. If they're not nearby, I don't give it a thought.
If someone called me a name I'd walk back and ask, "Who are you calling names, Helpless? I'm not your Mommy or your Daddy and your arms aren't broken so how about you keep your vulgar comments to yourself?"
Of course that's if he's not 6'-6" and 250 lbs.