undefined | Better HN

0 pointsffsm811mo ago0 comments

Are you serious unaware what a RAG is and still speak with authority on the topic?

It's automatically retrieving information and adding it to the context. It's -in spirit- a convenience function so you don't have to manually provide it during the prompt. It's just a lot harder to pull off well automatically, but the fundamental practice is "just" context optimization

You're essentially saying "but that's not driving!!!!" After someone goes by in an EV, because it's ain't an ICE

0 comments

3 comments · 1 top-level

belter11mo ago· 2 in thread

Not the same: "RAG vs. Long-context LLMs" - https://www.superannotate.com/blog/rag-vs-long-context-llms

ffsm8OP11mo ago

You're literally linking to an article that confirmed what I said. Yes, a model that has RAG will be able to perform with a lot smaller context size.

That doesn't mean RAG isn't context optimization.

belter11mo ago

Did you made any technical argument on how to reduce hallucinations? Because I fail to see one from you on this thread except: "it's the fault of your prompt""

j / k navigate · click thread line to collapse