A big distinction is that you can built on top (fine-tune) thus released models as well as if they released the pre-training data.

We should just call it open weight models at this point.

FWIW the Grok repo uses the term "open weights".

Exactly. Training data is key for any trained AI system. And I strongly suspect that every single company active in these modern AI systems is still struggling with how to tune their training data. It's easy to get something out of it, but it's hard to control what you get out of it.

> We don't know since no one is releasing their data.

Is anyone else just assuming at this point that virtually everyone is using the pirated materials in The Pile like Books3?

The model is open weight, which is less useful than open source, but more useful than fully propriety (akin to the executable binaries you compare to)

How about "weights available" as similar to the "source available" moniker?

Their data is the twitter corpus which is public. Or do you want a dump of their database for free too?

I'm sure just like in X's algorithms, @elon tweets are weighted heavily.