App to Run LLMs on Android (opens in new tab)

(play.google.com)

1 pointsValleZ2y ago3 comments

3 comments

One way to run LLM on android phone is to run ggerganov/llama.cpp in console like termux and it works quite well but is not super convenient. I was working on the app to make running on-device LLMs more user friendly, please try it out!

Zambyte2y ago

Cool project! Where is the source code for this?

ValleZOP2y ago

It's closed source for now, but it's based on llama.cpp and I'm planning to improve the included android example in the llama.cpp

j / k navigate · click thread line to collapse

3 comments

ValleZOP2y ago

Zambyte2y ago

Cool project! Where is the source code for this?

ValleZOP2y ago

It's closed source for now, but it's based on llama.cpp and I'm planning to improve the included android example in the llama.cpp

j / k navigate · click thread line to collapse