undefined | Better HN

0 pointsseydor3y ago0 comments

I m hoping chatbots will end up small enough they can run locally, everywhere. This is a lot of private data.

It may be doable - a chatbot with a lot of plugins does not need to know a lot of facts, just to have a good grasp of language. It can fetch its factual answers from the wikipedia plugin

0 comments

wahnfrieden3y ago

openai wants to gatekeep access and use of their AI. so why would they ever release a local LLM? i think that would come from their enemies

thanzex3y ago

I mean, GPT3 requires some 800GB of memory to run, do we all have gazillion dollars supercomputers at home? I think, unless there's some real breaktrough in the field or in the hw acceleration, this kind of model is going to stay locked behind a pricy API for quite some time.

int_19h3y ago

GPT-3.5 requires less. And neither model is considered size-optimal. It's just that with Microsoft's money, it's easier for OpenAI to move fast by throwing said money at more hardware rather than trying to optimize for size.

And yeah, I wouldn't expect them to share any model that is competitive with their current offering. But it can leak, and the copyright situation around that is very unclear at the moment.

seydorOP3y ago

they wouldn't ; i hope there will be an open source alternative. Firefox and chrome are open source

j / k navigate · click thread line to collapse