Skip to content
Better HN
Top
Best
Ask
Show
New
Jobs
Search
⌘K
0 points
XenophileJKO
4mo ago
0 comments
Save
Share
I mean you don't have to. With 0 temp, the only source of non-determinism is really the associative math chaning on accumulation of the floating point multiplication. That could be eleminated if we wanted to buy restricting the ordering.
0 comments
1 comments · 1 top-level
top
newest
oldest
bandrami
4mo ago
True but at that point you're not really using "an LLM" in the usual sense, you're using a very resource-hungry database.
j
/
k
navigate · click thread line to collapse