I think this myth emerges from the high-school jock vs nerd archetypes. The HSJ spends his time training, chasing chicks and neglecting his studies, while the more studious get on with their school work. Of course in reality you have smart people that are all-star footballers and stupid people who study, but I guess the less nuanced picture still dominates people conscience. I guess particularly because the school years are most formative.