I feel the same way. Imagine if Harvard had the ability to enroll one billion students per year. There would be no need to use either grades, SAT score, personal essays or anything else to reject students. They would be able to accept everybody, and then everybody could get an elite education and society would be so much better off.
But that would never happen. The whole point of ivy league is that they are exclusive. Companies get to feel special when they hire an ivy league grad so they can feel special for having one of the special chosen ones. If everyone gets to have an ivy league degree, then the ivy league degree becomes worthless.