Interesting perspective! That reminds me of the Dunning-Kruger effect, which essentially states that people with low mastery will over-estimate their actual abilities. And then as you get more experienced, you get a better understanding of your abilities.
I think it's also a matter of perspective as well. In some ways, I enjoy feeling less mastery in hobbies because I am taking a pure learning/enjoying mindset with hobbies. For work, I'm looking to maximize on stress reduction, so feeling competent plays a larger role.
