According to your logic there shouldn't be any women in the workplace with men at all since having attractive women will make men less productive.
My niece is studying to become a CS major and she has heard this argument once.
The culture is set by the worst behavior an organization is willing to tolerate.