undefined | Better HN

0 pointsQuantumGood2y ago0 comments

The longer I think about something, the dumber AI gets.

I have given our internal knowledgebase documents to ChatGPT and asked for summaries, and it adds in things from the general internet that are wrong to very wrong contradicting our KB (we are very far off the beaten path of conventional audio studio design testing).

0 comments

3 comments · 2 top-level

iamwil2y ago· 1 in thread

It's like the Gell-Mann Amnesia for AI.

QuantumGoodOP2y ago

I have questioned AI on topics I know little about, and it is terrible at handling queries. Frankly, I think this could be something taught: Can you use critical thinking well enough to break the AI?

skybrian2y ago

I think this effect is because we learn and the AI doesn't. (In the short term, for any given release of the AI.) Start asking about a topic that's new to you, and it will "know" things you don't. Then you learn those things, and it keeps making the same mistakes.

Over the longer term, new releases have improvements, but the feedback loop is currently pretty slow. It will likely get faster.

j / k navigate · click thread line to collapse