You won't see me call myself a socialist either, for similar reasons. You won't see me call myself an "-ist" in general.
I accept loser labels, which don't hold closer ties of specific affiliation. I'll say that I'm on the left and occasionally, although rarely, say I'm a leftist.
I call myself a pagan with a lower case "p" because that's a very loose association.
But mostly, these days, I stay the heck away from internalizing group affiliations with political/social movements.