By your logic you could reason that eventually all tax is paid by consumers because they pay the companies for the products and that includes corporate income tax and so on but whenever sales tax is low you will find that companies are more than happy to absorb the surplus as profits.
VAT is the closest governments get to taxing businesses directly on their revenue streams.
It's precisely how Dollar Trees and Dollar Generals have been pushing out grocery stores in the US right now, by not offering fresh produce, meat, or other traditional loss items. Planet Money even has a podcast on it: https://www.npr.org/sections/money/2019/04/26/717665452/epis...
Imagine the grocery store in your area carrying only frozen and canned meat and produce, because that is what it would push.
I'm not saying that there would be no effect, but it's not a complicated one.
>> and things carry on as normal otherwise
I don't think consumers will agree with you.