I’m not so sure. We “ban” drug markets and terrorist groups by denying them access to infrastructure all the time. Private businesses get to decide which businesses they provide services to. Freedom of assembly doesn’t mean you get to live in a trash strewn public square, nor on private property that is leeching toxic waste into the surroundings.