People in this hypothetical protected class are placed there by others. They're already segregated and marginalized, and generally no one asks them if they want that.
We have an example of that right here from TikTok.
"I determine you're ugly but you can still come into my nightclub" is not that much better than "I determine you're ugly and you can't come into my nightclub"