This "care what you think" phrasing I think is really deceptive. Because the active issue is whether you conform to group norms or refuse to do so.

If someone refuses to conform to a group, then demonstrably they don't care enough about the benefits of group inclusion to comply with the group demands.

If someone quits their job, they may in _some_ sense "care what the boss thinks," but there is a much more important sense in which they don't (while those who do not quit, do).

I guess people may be "loud" about their refusal, in various ways, because they don't want a refusal to conform to be mistaken for an inability to perform. Much like the person who is quitting does not want to be perceived as having been fired. Again, that is a very different kind of concern than the person who is trying to keep their job.