Open source model, created at great expense… by a still small cohort of people.

There are like a dozen organizations globally creating anything close to state of the art models. The fact that you can use some for free on your own hardware doesn’t change that those weights were trained by a small cohort of people, with training data selected by those people, and fine-tuning and “alignment” created by those people.

Sure you can fine-tune the smaller ones yourself, but that still leaves you at the will of original creator.

No, there aren't.

There is open source training and inference software. And there are open weights.

Those things are not enough to reproduce the training.

Even if you had the hardware, you would not be able to recreate llama (for example) because you don't know what data went into the training.

That's a very weird library. You can get their summaries, but you don't have access to the original works used when creating it. Sounds terrible, open source or not.

I find it odd that any LLM could be considered open source. Sure the weights are available to download and use, but you can't reasonably reconstruct the output model as it's impractical for an individual to gather a useful dataset or spend $5,000,000+ of GPU time training.

Are you able to build these models from source?