I read an article, that I can't find now, that convincingly argues that the SAT is one of the most equalizing factors for privilege. Impressive extracurricular, recommendation letters, and even grades are easier to buy than a higher SAT score.
Prep helps, but prep has a limit. A Golf tutor, high tier equipment, admission to private school with a large golf team, etc. are more easily bought.