I experience the same reaction often when I am discussing volatile issues with people. Its like if I say "I think A happens because of B", it doesn't mean that I have justified or condoned it. But some people can't separate it. I find it funny that sometimes people will respond with an opinion, and I will agree with them. Then they are like "But you just said" and I have to explain that I said A happens because of B, not that I am glad about it.
Definitely a frustrating phenomenon at times. I just avoid people more now.