For the most part, CVS isn't producing it, they're reselling it. I agree it doesn't matter
which reseller is gouging, but it does matter to me whether I'm paying a markup to someone who was clever enough to hoard important goods (and thereby incentivizing hoarding) or whether I'm paying for increased cost of production (and thereby incentivizing production).
Markets are a way of managing information. That's why things like "the stock market went up" or "the stock market went down" matter: it communicates what people believe about whether things are underpriced or overpriced. In turn, those beliefs are only worth paying attention to if participants have some reasonable information about the things they're buying and selling. While my individual purchase of a $50 bottle of hand sanitizer is a small drop in a bucket of information, it is conveying information, and everyone else paying for it absolutely does influence the market. When we communicate that we're willing to pay $50 for a bottle of hand sanitizer even if the cost of production has not gone up, it tells resellers that they should start hoarding. A clever reseller will stop selling their reserves entirely and wait for discovered prices to max out. That does matter quite a bit to me as a buyer!