undefined | Better HN

0 points_delirium1y ago0 comments

The probability of token generation is a function of the logits. Do you have an actual point related to the linked paper?

0 comments

1 comments · 1 top-level

That is one way of sampling tokens. It is not the only way. Logits do not map neatly to belief, although it is convenient to behave as if they do

j / k navigate · click thread line to collapse