Having worked with everyone over the course of my life from PhDs to construction workers, I'm going to have to hard disagree on this one. Just because someone is gifted in one area, does not mean their intelligence or domain expertise applies everywhere. Domain expertise is a real thing.
It's about maximizing your potential, and being in the best environment to do so. Building up that capacity might sound nice in theory, but in practice, you go where you can to get the best results possible.