undefined | Better HN

0 pointscs7025mo ago0 comments

Today, yes, it's true that AMD hardware can be competitive mainly for inference.

The story here is about the future. Over time, OpenAI would benefit if AMD hardware becomes competitive for training too.

Nvidia currently gets to charge whatever the market can bear on its dominant training hardware.

If AMD hardware becomes a real alternative for training, Nvidia will be forced to compete on price.

0 comments

giancarlostoro5mo ago

The reason I think its worth noting is that Inference is definitely what I imagine an insane amount of their computer is / will be spent on. I could see a very optimal setup where training is all Nvidia, but inference becomes reliant on AMD.

j / k navigate · click thread line to collapse

0 pointscs7025mo ago0 comments

Today, yes, it's true that AMD hardware can be competitive mainly for inference.

The story here is about the future. Over time, OpenAI would benefit if AMD hardware becomes competitive for training too.

Nvidia currently gets to charge whatever the market can bear on its dominant training hardware.

If AMD hardware becomes a real alternative for training, Nvidia will be forced to compete on price.

0 comments

giancarlostoro5mo ago

j / k navigate · click thread line to collapse