undefined | Better HN

0 pointsovergard23d ago0 comments

A gigabyte is a lot of memory. Even the largest context windows are a small fraction of that with any sane engineering discipline.

0 comments

1 comments · 1 top-level

For each LLM interaction they likely have bunch of thoughts traces, tool calls, etc, which don't go to context, but still can be retrieved.

But I obviously don't know for sure.

j / k navigate · click thread line to collapse