Of course allowing more housing impacts people. And people on their iPhones impact me -- when they're behind the wheel, when they're talking loudly in a restaurant, when I can't get their attention in a shop. The towers impact me (they're ugly and ubiquitous and use valuable spectrum). And lawnmowers? Those impact me, too! They're loud and stir up dust. I'm struggling to think of anything objectionable about sofas, but that just means 2/3 of my totally-arbitrary examples have significant impacts on others. And, because those examples were totally arbitrary, we could easily substitute three far more objectionable products.

You live in a society. Of course the things other people do impact you. That's a low bar, easily met, and not interesting enough to justify a ban on new housing. The impacts have to be overwhelmingly harmful to justify prohibition. Apartment buildings clearly do not meet that standard. You might not like apartments, but I love them, and banal preferences shouldn't drive policy in a free society.

If I did not want more people to live near me, I would simply not live in the most economically productive region in the country. People who hate other people are free to sell their homes and move to the country.