undefined | Better HN

0 pointskrainboltgreene3y ago0 comments

> It can reason correctly about hard problems with very little information.

i am so tired of seeing people who should know better think that this program can reason.

(in before the 400th time some programmer tells me "well aren't you just an autocomplete" as if they know anything about the human brain)

0 comments

sebzim45003y ago

>(in before the 400th time some programmer tells me "well aren't you just an autocomplete" as if they know anything about the human brain)

Do you know any more about ChatGPT internals than those programmers know about the human brain?

Sure, I believe you can write down the equations for what is going on in each layer, but knowing how each activation is calculated from the previous layer tells you very little about what hundreds of billions of connections can achieve.

krainboltgreeneOP3y ago

> Do you know any more about ChatGPT internals than those programmers know about the human brain?

Yes, especially every time I have to explain what an LLM is or anytime I see a comment about how ChatGPT "reasoned" or "knew" or "understood" something when that clearly isn't how it works by OpenAI's own admission.

But even if that wasn't the case especially yes do I understand some random ML project more than programmers know about what constitutes human!

dougmwne3y ago

Honestly, I don’t see how anyone really paying attention can draw this conclusion. Take a look at the kinds of questions on the benchmarks and the AP exams. Independent reasoning is the key thing these tests try to measure. College entrance exams are not about memorization and regurgitation. GTP-4 scores a 1400 on the SAT.

krainboltgreeneOP3y ago

No shit, a good quarter of the internet is SAT prep. Where do you think GPT got it's dataset?

j / k navigate · click thread line to collapse

0 comments

sebzim45003y ago

>(in before the 400th time some programmer tells me "well aren't you just an autocomplete" as if they know anything about the human brain)

Do you know any more about ChatGPT internals than those programmers know about the human brain?

krainboltgreeneOP3y ago

> Do you know any more about ChatGPT internals than those programmers know about the human brain?

But even if that wasn't the case especially yes do I understand some random ML project more than programmers know about what constitutes human!

dougmwne3y ago

krainboltgreeneOP3y ago

No shit, a good quarter of the internet is SAT prep. Where do you think GPT got it's dataset?

j / k navigate · click thread line to collapse