undefined | Better HN

0 pointsImustaskforhelp11mo ago0 comments

Pardon me, but is the dataset public.

Like if I really really just wanted to build it from scratch, could I do so? (not that I have that money but just curious)

0 comments

4 comments · 1 top-level

hynky11mo ago· 3 in thread

yes, both core web datasets are publicly available as well as the rest

ImustaskforhelpOP11mo ago

Thanks!

To be honest, if I might argue then that this is one of the best truly open source models that we have got.

There is AllenAI and (Elmo?) and there is also this one which does distributed training but I think this looks a lot like SOTA for 3B parameters to me.

Thanks for telling me, I am not going to lie, I am going to try to test it now! (Ima try some GGUF since ollama convenience)

peatmoss11mo ago

OLMo: https://allenai.org/olmo

AFAIK, they were the first open everything model.

1 more reply

vixalien11mo ago

there’s also IBM’s Granite

j / k navigate · click thread line to collapse