undefined | Better HN

0 pointsshanebellone3y ago0 comments

Humanity isn't stateless.

0 comments

3 comments · 1 top-level

chpatrick3y ago· 2 in thread

Neither is text generation as you continue generating text.

shanebelloneOP3y ago

"Neither is text generation as you continue generating text."

LLM is stateless.

chpatrick3y ago

On a very fundamental level the LLM is a function from context to the next token but when you generate text there is a state as the context gets updated with what has been generated so far.

2 more replies

j / k navigate · click thread line to collapse