Colleges have limited ability to help with those factors so they apply weights where they can. Hell even the SAT itself has a pretty regressive impact because most colleges will let you submit your highest score from multiple tests, I got 2 800s but it took 2 tests (not counting a couple PSATs I got various times) to get that a chance a poorer person is much less likely to have.