One common story that is told is that men have more variance in outcomes than women; regardless of whether men are taller, the very tallest and shortest individuals are both male. So if you select for the people with the most board memory, the most pattern recognition, the most patience, and whatever other weird traits, you could have entirely equal representation if you take the top 50% or the top 10%, but the top 0.1% could be all male.