One is likely the majority, the other the minority.
It doesn’t negate any behaviour based on bias but would require an honest reflection on the unconscious biases existing in the workplace prior to this.
One way to look at it is minority groups who can’t turn off being visible minorities can be different than people who may be minorities in a a few areas of life but still have access to benefit from privilege in others.
Neither of you should experience that. Your experience does not negate his. Nor his yours.