Much of that are involves forests far away from where people would want to live anyway. Often without roads.
When people say the issue is land, that usually implies a very particular smaller subset of land which is in proximity other populations, economic centers, and with certain features and infrastructure.
There are also plenty of houses in recently a abandoned ghost towns. The catch is that they were mostly abandoned due to lack of jobs nearby, meaning nobody could afford to live there.