What I choose to read or watch is really completely orthogonal with who I choose to spend time with. I enjoy spending a significant amount of time investigating contrary points of view, and find it very valuable.
That does not mean I wish to spend the time I spend with others hanging out with people who actively hold contrary positions particularly if we do not agree on the terms of discussion. I can be respectful of those people [0], and listen to them, without making the choice to spend (optional) time with them.
If your cancelling really involved those things, then I am sorry that you had to experience this, and am glad that you've found some peace in the aftermath. An awful lot of what is called "cancelling" at the present time does not amount to the things you've described.
[0] EDIT: actually, this is dishonest. If someone does not agree with the same terms of discussion, I find it very hard to actually respect them, even if I can "be respectful" in person.