Not everyone can have a location independent job. Many places that seem “affordable” lack decent paying jobs. And the areas with the highest paying jobs are filled with people who scream that people should go live somewhere else.
These are people who started the race a mile ahead and think they are superior runners. They’ve done very little to earn what they have and are fighting like hell to avoid even mild inconveniences to themselves (e.g. an affordable development for low income seniors or teachers).
Before you say “well this is what voters want” voters at the state level got legislation through that mandated changes and the minority of voters in a handful of well off areas are actively disregarding that law.