Are people really supposed to be insulted over being called “Antifas?”

I mean, I kinda take pride in being anti-fascist. Am I missing something?