undefined | Better HN

tveita1mo ago

> who put the Transformer into LLMs?

Google?

> who invented neural networks

People like Geoffrey Hinton, who was notably at Google Brain from 2013 to 2023?

The people who say Google was ahead were paying attention long before you were.

saberience1mo ago

Google didn’t invent neural networks, neural networks existed before Google was founded.

1 more reply

kllrnohj1mo ago

> Great, tell me again who put the Transformer into LLMs?

Google did, as they already said.

OpenAI was better at marketing and a lot more willing to cannibalize the search market as a newcomer. So Google blew their lead in research by not recognizing the product value quickly enough, or failing to win an internal political war on it anyway

erikerikson1mo ago

The tone on this could be improved. They literally answered your question "What lead?" and you seem dismissive.

embedding-shape1mo ago

Yeah, you're right, maybe needlessly harsh, sorry for that. I guess I'm tired of the same argument that Google somehow had a lead in LLM development because Transformer comes from researchers who worked at Google, yet somehow what comes before/after Transformer doesn't count, coming from Google's researchers (BERT) or others (GPT), or going even earlier so, hence the whole "we stand on the shoulders of giants".

1 more reply

0 comments

0 comments