undefined | Better HN

0 pointsXenophileJKO2mo ago0 comments

Context is the information you give the model, attention is what parts it focuses on.

And this is finite in capacity and emergent from the architecture.

0 comments

lwhi2mo ago

So attention is based on a smaller subset of context?

j / k navigate · click thread line to collapse

0 pointsXenophileJKO2mo ago0 comments

Context is the information you give the model, attention is what parts it focuses on.

And this is finite in capacity and emergent from the architecture.

lwhi2mo ago

So attention is based on a smaller subset of context?

j / k navigate · click thread line to collapse