These things can accumulate and ruin lives. I'm surprised that there haven't been more class action lawsuits against "errors" like these. Because it might seem like a benign accident -- but how many people have lost important parts of their lives – banking, photos of their children and more – because "computer says no?"

Eventually, these systems will be mostly artificially generated, and perhaps the machines will have fewer error rates than the humans. Perhaps not. But how many humans will understand the machines well enough to ask these questions in the first place?

Machines were supposed to free us from bureaucracy. Not freeze it everywhere with few avenues for escape.

I have had an encounter with something like this via Wise / Transferwise. It has been half a decade and nada. And I estimate that it has cost me north of $20k+ over that time.

Google, Wise and heck Maps were started with the ambition of adding something to the world — e.g. Google's original "organize all knowledge" mission - but over time cruft accrues and these companies rapidly accumulate negative side effects / drift away from their core mission.

When was the last time Google / Alphabet / whatever did something that involved improving access to the world's knowledge? They've degraded their search to the point of uselessness and beyond. Slowly alienated their best researchers and engineers. And done their best to turn away from the entity that made Google Books — "we'll scan all the books for the good of all humankind."