A bunch of poor people buy some cheap land with very low taxes because its a run down scruffy mess with no facilities.
The land stays a run down scruffy mess with no facilities because the local property owners have strong financial incentives to keep it that way
Incremental increases in the land value tax would make low income landowners hungry long before the land rose in value enough to make anyone millionaires, and land isn't exactly easy to sell quickly, especially not if it's marginally-less-shitty-than-before land with an uncertain future.