Aside from things like pronouns, English hasn't been gendered since the 14th century:

https://en.m.wikipedia.org/wiki/Gender_in_English

'Aside from that Mrs. Lincoln, how was the play?'

Pronouns are precisely what folks who complain about gender in English are complaining about (well, that and words like 'mankind').

Glibness aside, the usage of gendered pronouns does not make a language gendered. That's only true if there has to be agreement between the gender of a noun and words relating to the noun.

And it's also not what people are arguing. Instead, they argue that gendered terms are the product of cultural norms and prescriptive grammar that reinforce gender roles that are oppressive to both men and women. That some view these assignments as objective when that's untrue linguistically and historically, I think only lends credence to their point.