I built an open source Computer-use framework that uses Local LLMs with Ollama (opens in new tab)

(twitter.com)

4 pointspowerawq10384611mo ago1 comments

1 comments

We just launched stable support for local LLM models with Ollama in Agent today - our Computer-use agent framework on macOS. Repo here: https://github.com/trycua/cua

Run models like Gemma3, Phi4, Qwen2.5, Llama3.1 & more supported by Ollama, keeping your data completely private - no cloud required.

Agent with local LLMs combines UI grounding with pixel-detection for accurate computer control with Pyautogen OmniParser - all in Cua's sandboxed environment for security.

Privacy-conscious? Local models through Ollama run entirely on your machine while maintaining the same powerful agent capabilities backed by MPS on Apple Silicon.

Simple to set up: just `pip install "cua-agent[all]"` and connect to your local Ollama models. Check out our examples on our repo: https://github.com/trycua/cua

j / k navigate · click thread line to collapse

1 comments

powerawq103846OP11mo ago

We just launched stable support for local LLM models with Ollama in Agent today - our Computer-use agent framework on macOS. Repo here: https://github.com/trycua/cua

Run models like Gemma3, Phi4, Qwen2.5, Llama3.1 & more supported by Ollama, keeping your data completely private - no cloud required.

Agent with local LLMs combines UI grounding with pixel-detection for accurate computer control with Pyautogen OmniParser - all in Cua's sandboxed environment for security.

Privacy-conscious? Local models through Ollama run entirely on your machine while maintaining the same powerful agent capabilities backed by MPS on Apple Silicon.

Simple to set up: just `pip install "cua-agent[all]"` and connect to your local Ollama models. Check out our examples on our repo: https://github.com/trycua/cua

j / k navigate · click thread line to collapse