undefined | Better HN

0 pointsenriquto1y ago0 comments

> What is the equivalent of the training data for something like the Linux kernel?

It's the source code.

For the linux kernel:

          compile(sourcecode) = binary

For llama:

          train(data) = weights

0 comments

jdminhbg1y ago

That analogy doesn't work. `train` is not a deterministic process. Meta has all of the training data and all of the supporting source code and they still won't get the same `weights` if they re-run the process.

The weights are the result of the development process, like the source code of a program is the result of a development process.

j / k navigate · click thread line to collapse

0 comments

jdminhbg1y ago

The weights are the result of the development process, like the source code of a program is the result of a development process.

j / k navigate · click thread line to collapse