undefined | Better HN

0 pointsdavekeck2y ago0 comments

> then some lower probability tokens may be chosen

Can you explain how it chooses one of the lower-probability tokens? Is it just random?

0 comments

2 comments · 1 top-level

acchow2y ago· 1 in thread

Reducing temperature reduces the impact of differences between raw output values giving a higher probability to pick other tokens.

Oops backwards. Increasing temperature...

j / k navigate · click thread line to collapse