If, as real property analogy, I have fee simple title to a parcel part of which is subject to utility easement, the utility company’s access within the scope of the easement is not an infringement of my right of exclusive control, it is outside of the scope of that right.

Similarly, most people who support laws that you see as “infringing” on the right of free speech who agree that a right with that name exists view the definition of the scope of that right more narrowly than the people who see the law as an infringement.