Remote workers from rich countries do pay tax locally, in the form of VAT and sales taxes. And they typically spend far more than locals, on food to accommodation and everything in between, all while requiring nothing of the local welfare state. It's a direct wealth transfer of thousands per month, earned in one economy and spent in another. In purely economic terms, it's hard to see how this is anything but a good deal for the host country, in the large majority of cases. Hence digital nomad visas.

This is not to say that countries - and societies - don't have the right to allow or deny access to foreigners as they see fit.

One thing to note is that even if you're not paying income tax there, you're bringing tons of money into the country from outside. So that's worth something.