undefined | Better HN

0 pointsVuizur3y ago0 comments

Decent local LLMs such as Vicuna-7B are already able to run on phones with 8 GB RAM: https://mlc.ai/mlc-llm/

Right now it's a prototype, but in the future local LLMs will be everywhere.

0 comments

1 comments · 1 top-level

I really, really hope this is the case. Trying to be optimistic about this in spite of my skeptical nature :)

j / k navigate · click thread line to collapse