Personally, I would agree that it's your responsibility for your own land, but I also don't believe in forcing owners to do what I personally want them to do. If you can own a farm without polluting across the street, say,to my house, I really can't care what you do. If you want to sell the farm and throw up a bunch of houses, again, as not as you don't screw with my land and my ability to pass it on to future generations.
I do NOT agree that I an responsible for my neighbors or their land and this is part of the issue. If my farm dumps a bunch of crap or ejects a ton of pollutants into the air, this harms my neighbor and should be limited. If instead, I build my farm and is net 0 pollutants to your land, why exactly should you be able to do on 'my' land, or put another way, who is the victim?
To frame this another way that I think is fairly similar to nuclear, I think large scale organic farming is extremely taxing to the land in the long run and is a fairly terrible agricultural practice at our current scale. Does this mean we should enact laws and regulations to stop organic farming? I'm really not so sure, I can understand both sides and I don't think this type of legislation will ever be so cut and dry.