If you hold it physically, you have to store it and secure it, which costs money.
If you deposit it in a commercial bank, it'll be less safe than German bonds.
A record where, though?
Bank "clearing" means that ultimately a bank is keeping its money either with other banks or with the central bank. They're records, but not necessarily interest-bearing, and keeping it with other banks is not risk-free.
When you talk about "money being electronic" you're basically talking about bonds. When people (or companies, foreign governments, etc.) want to hold large quantities of USD they don't really hold USD, they hold short-term US government bonds.
The only truly "real USD" is physical cash, or an account balance at the Federal Reserve (which is available only to banks).
So people don't own bonds just because of the coupon, it's also really the only convenient way to own (something mostly equivalent to) currency -- other than keeping it in a private bank, which is much more likely to fail than the government.
(I realize we're talking about German banks, and FDIC is a US institution)