I disagree with you that there is no reason to do so for “non-sexists”. Because no one knows how a given person may interpret a given conversation or activity, combined with the severe consequences from the social media mob that even something as simple as an unsubstantiated tweet can inflict on one’s career or an entire company these days, the only way to avoid liability is to minimize interaction between opposite sexes in the workplace. In this environment, it’s the only rational thing to do.
We have unleashed a virtual lynch mob, ready to instantly torch the life of anyone that stands accused of even moderately inappropriate or questionable behavior. Worse, there is no statute of limitations or standard of proof required to activate the mob - a tweet is enough. That is wrong and creates a toxic environment for everyone.