Then people want to use it in the sense of, you don't have a right against someone else interfering with your interaction with your willing audience, i.e. you don't have a right not to be censored by a government or corporate oligopoly. But that is a far less defensible proposition.