The only term I can think of that’s used in such a disparaging way is “teabagger”— which is also something I don’t do— and I’ve certainly spoken up when people who aren’t actually Tea Party types have been labeled as such. As I said, neo-con, back in the day, was something that a lot of the ‘left’ used as their catch-all for conservative, and it was just as stupid.
I do not see the point of being insulting just for the sake of being insulting. I never have.