Ask HN: Climate Concerns Using ChatGPT

4 points0xfedbee3y ago5 comments

Am I the only one who thinks twice before pressing "Send" on ChatGPT because of how much resources it needs to give me the answer?

Ask HN: Climate Concerns Using ChatGPT

4 points0xfedbee3y ago5 comments

Am I the only one who thinks twice before pressing "Send" on ChatGPT because of how much resources it needs to give me the answer?

5 comments

5 comments · 2 top-level

thewataccount3y ago· 3 in thread

Can someone check my math on this? Supposedly ChatGPT uses 8x A100's per request. If we say each request takes 5 seconds, and a A100 uses 300watts.

(300w * 8) * 5 = 12,000 watt/sec or 12,000 joules

12,000/3600s = 3.3 watt/hour ?

This is just over the amount of power in a lithium AA battery according to wolframalpha.

0xfedbeeOP3y ago

To me that's still a lot. A whole AA battery for a single response. Maybe I'm just built this way.

thewataccount3y ago

They do add up a bit. I'm concerned about a future where we do this for _everything_ because that'll truly be a massive scale unless we get smaller models. If we go off 10M queries a day that's

0.0033KW/H / 24 = 0.0001375/D

0.0001375KW/D * 10M = 1375KW/D or 1.375MW/D

(if I did that right)

arbol3y ago

This is a crazy amount of power for a single request.

geod_of_ix3y ago

Unfortunately, yes.

j / k navigate · click thread line to collapse