For instance, highly skilled people will often underestimate the difficulty of a task for average skilled people, because they complete it with relative ease. It's effectively an overestimation of what "average" is, because they think of themselves as average when they're really not.
"Relative" is the key word here. Your natural high skill performer may think a task is difficult, but they don't necessarily find the same sources of difficulty as average people.