undefined | Better HN

0 pointsmort961y ago0 comments

Healthy humans generally have some internal model of the world against which they can judge what they're about to say. They can introspect and determine whether what they say is a guess or a statement of fact. LLMs can't.

0 comments

zmgsabst1y ago

Humans routinely misremember facts but are relatively certain those remembrances are correct.

That’s a form of minor, everyday hallucination.

If you engage in such thorough criticism and checking of every recalled fact as to eliminate that, you’ll crush your ability to synthesize or compose new content.

mort96OP1y ago

No, that's not hallucination.

In a human, there is a distinction between "this is information I truly think I know, my intention is to state a true fact about the world" and "this is something I don't know so I made something up". That distinction doesn't exist in LLMs. The fact that humans can be mistaken is a completely different issue.

mdp20211y ago

> If you engage in such thorough criticism and checking of every recalled fact as to eliminate that, you’ll

Experience tells us differently: creativity is not impacted. In fact, it will probably return better solutions (as opposed to delirious).

j / k navigate · click thread line to collapse