Sounds callous.
I would focus first on banning the use of homes as investment and permitting mixed-use, medium- to high- density construction (with something like 15 min city as a point of reference) before we reach for the big hammer and start coercing the poors out of their homes.
