Skip to content
Better HN
Top
New
Best
Ask
Show
Jobs
Search
⌘K
undefined | Better HN
0 points
Majromax
3mo ago
0 comments
Share
If you remove the conditional and keep the same math, you divide by zero and get nans.
In the limit
as temperature goes to zero, you do in fact get maximum likelihood sampling.
0 comments
default
newest
oldest
dnautics
3mo ago
if (t==0) argmax(logits) else pick(logits)
eru
3mo ago
You are ignoring the limit taking.
1 more reply
j
/
k
navigate · click thread line to collapse