Is the Llama 3.1 model open source?
Yes.
Really?
No.
Training Data = Source Code
This time, the Llama 3.1 model was released as open source. However, the training data is not disclosed. In AI and deep learning, training data is the "source code," while the model is like an app. Therefore, Llama is not truly open source. It's more like a free language model app has been released.
When Meta's Zuckerberg released Llama, he mentioned Linux and posted, "Open Source Al is the Path Forward“.
While Zuckerberg looks cool and we appreciate him,
still, we should understand that Llama is not open source. To be open source, the training data must be disclosed. We should not be under the illusion that Llama is open source. (Training data size: approximately 15 trillion tokens)
