undefined | Better HN

0 pointssurgical_fire22h ago0 comments

It's impossible to tell at this point. I have no idea how much of their compute is also subsidized through deals they have with the hyperscalers, etc.

It's irrelevant how big their models may or may not be. Depreciation needs to be taken into account, so does actual compute expenses. Training those models is not cheap, and you will never reach a point where a model is "final". You will always need to train the next one.

Eventually the bill has to be paid. Money and resources are finite still.

0 comments

3 comments · 1 top-level

HDThoreaun22h ago· 2 in thread

Well the third party operators on open router are assuredly operating at a profit, including depreciation. The only reason they’d be profitable at 1/10 the price of the labs while the labs aren’t profitable is if inference costs the labs 10x as much per token

surgical_fireOP20h ago

> Well the third party operators on open router are assuredly operating at a profit, including depreciation

They don't train new models.

They have to depreciate their GPUs, which I hope they do.

HDThoreaun19h ago

I agree inference probably isn’t profitable yet if you include training costs. My claim is that marginal revenue from inference is higher than marginal cost. If that’s the case then if they scale enough the training costs will be amortized.

I realize I said assuredly when I meant assumedly. My mistake. I agree it’s possible that the third party open model hosters aren’t actually profitable, my claim does rest on the opposite.

j / k navigate · click thread line to collapse