My point is busy people do even more of the things that you think make you busy.
You think kids are taking up all your time? They have more kids and volunteer at the school, and run a church group, etc.
The clock is secondary because using time efficiently, planning, and classifying which hours you are awake and available are all skills.
Similar patterns happen all throughout life. People have non linear capacities and performance.