Exactly. Up to some point, you actually do well
because you are smart. Then, in the middle of the game, the rules change (from your perspective), and it may catch you by surprise.
It would be much better for the gifted children to attend schools where their effort is visible since the beginning. That is, schools with other gifted children.
For example, in math, my kids didn't learn anything new during their first three years of the elementary school, because they already knew numbers and addition at kindergarten age. Yet they were forced to sit there for three years. It would have been better to give them a book to read, or a collection of interesting problems to solve.