I too want to believe in a deeper conspiracy around this shitshow, but occam's razor says that it's probably a mix of:

* it's a hard problem to solve

* nobody wants to solve that problem

* it's a national crisis, not just an SF crisis

* people are incompetent and governments are slow to move (and rarely make use of data correctly)

* things generally tend to get better only after they get worse