Why do LLMs attend to the first token? (opens in new tab)

(arxiv.org)

2 pointsadhi011y ago1 comments

1 comments

1 comments · 1 top-level

maytc1y ago

Curious if the authors had a chance to look at the Softpick paper? https://arxiv.org/abs/2504.20966

j / k navigate · click thread line to collapse