undefined | Better HN

0 pointsthiago_fm5mo ago0 comments

For inference there are many solutions like groq. The margins there will be small.

The fat margins is in training, in NVidia hardware.

0 comments

Inference margins will be small(er) but it will be much bigger in market size than training.

That said, I'd much rather be leading in training than inference, of course. Nvidia still leads in inference, by the way.

j / k navigate · click thread line to collapse

0 pointsthiago_fm5mo ago0 comments

For inference there are many solutions like groq. The margins there will be small.

The fat margins is in training, in NVidia hardware.

Inference margins will be small(er) but it will be much bigger in market size than training.

That said, I'd much rather be leading in training than inference, of course. Nvidia still leads in inference, by the way.

j / k navigate · click thread line to collapse