For example, I had very poor grades in high school (would not have been described as academically gifted) and used state funds to go to undergrad to study science. Ended up just being a late bloomer, graduated summa cum laude with a degree in chemistry and went on to get a PhD in theoretical chemistry. Higher education shouldn't be restricted to just students who appear gifted, but should be available to anyone who wants to put in the work.
I agree that college should not be a requirement for good entry-level jobs, however, I don't think that college admission in general (there will always be elite private institutions) should be heavily restricted based on my personal experience.
Edit due to sibling comment: I did poorly on the math placement test for college as well and had to take remedial math courses. I ended up minoring in math and taking some graduate level courses in numerical analysis during undergrad. So the idea that colleges shouldn't have remedial classes is ridiculous.