App to Run LLMs on Android (opens in new tab)

(play.google.com)

1 pointsValleZ2y ago3 comments

3 comments

3 comments · 2 top-level

Zambyte2y ago· 1 in thread

Cool project! Where is the source code for this?

It's closed source for now, but it's based on llama.cpp and I'm planning to improve the included android example in the llama.cpp

ValleZOP2y ago

One way to run LLM on android phone is to run ggerganov/llama.cpp in console like termux and it works quite well but is not super convenient. I was working on the app to make running on-device LLMs more user friendly, please try it out!

j / k navigate · click thread line to collapse