It gets better; most of their incoming requests don't actually require a frontier model to handle. There's a huge potential for future optimization in this space. Anthropic, OpenAI, Google and a few other companies are going to be well positioned to scale in the few years. A 65$ billion round to finance operations over the next few years isn't that controversial if you look at the growth and profit potential.

I think token counts and GW are a gross over simplification here. Not all tokens are the same in the amount of GPU time they consume or the size of the GPUs they require or the amount of energy they consume. There's a huge optimization potential here once these companies get serious about consolidating the business they have and executing much more efficiently. Given enough time, these companies can heavily optimize their operations. Short term growth and not slamming the brakes on that is their primary concern.