undefined | Better HN

0 pointscsomar1y ago0 comments

Models are predictable at 0 temperatures. They might have tested the output beforehand.

0 comments

Models in practice haven't been deterministic at 0 temperature, although nobody knows exactly why. Either hardware or software bugs.

Jensson1y ago

We know exactly why, it is because floating point operations aren't associative but the GPU scheduler assumes they are, and the scheduler isn't deterministic. Running the model strictly hurts performance so they don't do that.

fzzzy1y ago

Cool, thanks a lot for the explanation. Makes sense.

j / k navigate · click thread line to collapse

0 comments

fzzzy1y ago

Models in practice haven't been deterministic at 0 temperature, although nobody knows exactly why. Either hardware or software bugs.

Jensson1y ago

fzzzy1y ago

Cool, thanks a lot for the explanation. Makes sense.

j / k navigate · click thread line to collapse