I agree. It's an extremist position to say that money should be outside the rules of society.
Let's take an experiment. Instead of "I should be free to send money to anyone anywhere", we'll replace money with a car.
"I should be free to drive my car anywhere, anytime". Sounds superficially like a reasonable proposition even? But in fact we have lots of rules that control who can drive a car, where, under what intoxication. There are driver's licenses, traffic signs, road police... Ultimately a judge will put you in jail if you exercise your freedom to drive outside of society's rules.
Now imagine someone using the pseudonym Suzuki Toyotamoto invents a car made out of floating jello with an engine that runs on nuclear waste. Many engineers will marvel at the ingenuity of the design. Some people start building their own jello blobs and driving them off-road without a license. The law says nothing explicitly about transportation inside floating jello. Eventually people take their floating jello vehicles to roads and get fined. (The jello moves barely at walking speed and drips radioactive sludge.) Outrage blows up in the floating jello community. Do the old rules apply to them? Will the whole world switch over to floating jello? (These questions may seem very important to those versed in the world of Suzuki Toyotamoto's floating jello, but most people just don't care and will happily keep using their regular cars instead of sitting in slime powered by radioactive waste.)