If the market reduces because of a lack of investment, wouldn't the currency reduce because you hold the same proportion of a smaller thing, creating an incentive to stop negative growth.
There is also the factor of the OP's so-called CryptoBarons. Money is just an idea until you actually spend it. If there are a number of people living it up because they got a bunch of bitcoin really early the result would be essentially another form of bitcoin creation. Those CryptoBarons would be adding currency into circulation as they spend, currency that was effectively frozen before that point.
I'm not sure what will happen in the end, but it will certainly be an interesting ride.