Ok but that that's a complete fork for the conversation. You're talking in terms of a philosophical land usage/property right debate; I see your point. I might not completely agree with it, but I see it. However, I'm not trying to have a philosophical debate. I'm talking about real terms of the world we live in today where it's highly unlikely anyone is going to be able to scrap all the existing rules, laws, norms, etc and come up with some new construct.
I am unaware of any place where neighboring property owners are not considered when contemplating what a property owner is allowed to do. You're saying the property owner shouldn't be regulated at all, which is fine except you're not the decision maker and other people will disagree with you. The net effect is what we have now. It's not perfect, some people will always disagree but the idea is it works for most people most of the time.