Really, what it is is being dominated by Testosterone. Also why we ban steroid use, and many other things along the same lines.
I would suggest that most Olympians - both female and male (whatever your definition) likely have a higher than normal amount of that hormone.