The fact is that there is no single "smart". Instead there are many aptitudes, which combine and overlap to make people good or bad at specific skills.

Arnold Schwarzenegger was strong, but an average rock climber could best him at rock climbing. The average long distance runner could run laps around him.

We all understand this to be the case with respect to physical activities, but for some reason this idea of single-faceted intelligence persists.