Believe it or not billionaires are part of the public and those billions are in circulation. There are no dragons sitting on hoards of gold.
More importantly: money that is not in circulation doesn't affect you or me, it has the same weight on the economy as all the gold still not mined.