undefined | Better HN

0 pointssebzim45002y ago0 comments

I would imagine that most people use nonzero temperature, so they won't need to look for any explanation for non-determinism.

0 comments

2 comments · 1 top-level

dekhn2y ago· 1 in thread

Literally the first thing I did when I had llama.cpp working was set the temperature to 0 and repeat queries.

(but that's mainly because I'm a weird old scientist with lots of experience with nondeterminism in software).

refulgentis2y ago

I did too, Kmeans broke me a couple years ago: but, never temperature at 0 with long length, and trusted my instinct instead of actual diffs. This is was the first time I actually diffed

j / k navigate · click thread line to collapse