I think the stigma is based on alleged bad behaviour. As this behaviour has nothing to do with gender I don't think it's accurate to say this is sexism. I could be wrong.