undefined | Better HN

0 pointstypon3y ago0 comments

I read a lot on Twitter about the so-called "culture" of Google that prevents them from making AI based products, meanwhile OpenAI has made ChatGPT and is going to replace Google search within the next two months or so. I think this is the same narrative that's being expressed by the GP comment.

To add to your comment, Google has been using BERT to power Search since 2019: https://blog.google/products/search/search-language-understa...

I'm going to guess that the only reason they don't use larger models is because of the compute cost. ChatGPT at 4 billion users with today's hardware is an unsustainable business. However, that thought leads me to imagining: if Google offered Search "Premium" using the latest LLMs, how much would people pay for it?

0 comments

lossolo3y ago

> if Google offered Search "Premium" using the latest LLMs, how much would people pay for it?

I think they need to solve hallucination problem first, they are already working on optimization eg FLAN-T5 (smaller LLM models same performance) and RETRO (retrieval transformer that can use data index outside of the model) that takes them closer to use it in search.

astrange3y ago

Apparently you can avoid hallucination by basically reading the model’s mind instead of asking it questions.

https://arxiv.org/abs/2212.03827

Raises some ethical issues…

j / k navigate · click thread line to collapse