Well, that is basically why, as a society, we have devised ways to deal with disagreements over the nature of what should be. In US that does mean civil suits if all else fails.

Not to search very far, in Colorado neighbors sued for lowered property values due to marijuana smell from dispensary.

For better or worse, US property values do make a powerful argument for people to take their rights rather seriously.