undefined | Better HN

0 pointsKMnO42y ago0 comments

Is tiny LLM an oxymoron? I believe Apple has told us it’s a transformer language model, but not specifically a LLM.

0 comments

5 comments · 4 top-level

catoc2y ago· 1 in thread

Yeah, they meant a TLM

0x1ceb00da2y ago

That's print('Hello, world!')

ben_w2y ago

It's like how the "New Forest" is really old now: even small LLMs are (from what I've seen which isn't exhaustive) large compared to Markov language models.

hmottestad2y ago

According to this article[1] it has about 34 million parameters.

https://jackcook.com/2023/09/08/predictive-text.html

astrange2y ago

There's no difference. An LLM is just a transformer language model that's "large".

j / k navigate · click thread line to collapse