> Just ditch it and let anyone move money around with no controls. I'm sure that would work out fine.
It did, for thousands of years. The only thing that's new is the ability to track every penny and person from cradle to grave and the incessant and ever-growing desire for those in power to control those who aren't.
One of the reasons people use gold is because carrying it around is actually pretty easy. Eg, wandering the streets with a few million in gold bars is no challenge. You can carry it in a bag and the odds of someone checking your bag for millions of dollars in hard assets is low.
Not to mention that if the gold is banked then it probably didn't need transport because it was being transported too and from a bank.
Well, the OP did say thousands of years. But I take your point, money transfer without moving physical gold has been possible for hundreds of years for sure.
and for thousands of years the rich did pretty much what they wanted, and the rest of us lived barely above subsistence level.. fair taxation is one of the building blocks of modern society
That's like saying going without vaccinations, clean water, or adequate medical care "worked out fine" for thousands of years.
Sure, the human race survived. Many individuals even thrived. But I don't think it's really disputable that life with them is massively better than life was before we had them (or, in fact, than life is now for the far too many who still lack them in a reliable way).