I would argue that depends on the intent. Do i put them in a disadvantage because they are part of that group or because a large part of that group wouldn't fit the requirements i have.

Lets say i'm looking for someone doing voiceover. Someone without an accent. That would probably put a lot of non-native english speaker in a disadvantage. Would you argue, that i'm discriminating against them or have racist intentions?

In this diversity session they would then argue my knowledge that non-native english speaker are put in a disadvantage by this requirement was the reason to put it in and therefor i'm racist.