undefined | Better HN

0 pointsnomilk1y ago0 comments

It was mentioned during the launch that current datacenter requires up to 0.25 gigawatts of power. The datacenter they're currently building will require 1.25 (5x) (for reference, a nuclear powerplant might output about 1 gigawatt). Will be interesting to see if the relationship between power/compute/parameters and performance is exponential, logarithmic or something more linear.

0 comments

zurfer1y ago

It's logarithmic. Meaning you scale compute exponentially to get linearly better models. However there is a big premium in having the best model because of low switching costs of workloads, creating all sorts of interesting threshold effects.

energy1231y ago

It's logarithmic in benchmark scores, not in utility. Linear differences in benchmarks at the margin don't translate to linear differences in utility. A model that's 99% accurate is very different in utility space to a model that's 98% accurate.

WanderPanda1y ago

Yes, it seems like capability is logarithmic wrt compute but utility (in different applications) is exponential (or rather s-shaped) with capability again

Xelynega1y ago

Not really since both give you wrong output that you need to design a system to account for(or deal with). The only percentage that would change the utility would be 100% accurate.

Davidzheng1y ago

Linear in what metric?

535188B17C937431y ago

Presumably the benchmarks? I'm also interested.

1 more reply

smeeger1y ago

this is like a caveman dismissing technology because he wasnt impressed with the wheel. its like buddy, the wheel is just the start

zozbot2341y ago

> It was mentioned during the launch that current datacenter requires up to 0.25 gigawatts of power. The datacenter they're currently building will require 1.25 (5x) (for reference, a nuclear powerplant might output about 1 gigawatt).

IIRC achieving full AGI requires precisely 1.21 jigawatts of power, since that's when the model begins to learn at a geometric rate. But I think I saw this figure mentioned in a really old TV documentary from the 1980s, it may or may not be fully accurate.

esafak1y ago

The funny part was that none of his workers recognized the film, which was a blockbuster. A veritable "I must be getting old" moment.

karparov1y ago

And fun fact, without govt subsidirles, a nuclear power plant isn't economically feasible, which is why Elon isn't just building such a plant next to the data center.

j / k navigate · click thread line to collapse