undefined | Better HN

0 pointsmax-privatevoid16d ago0 comments

I sure love when the local-first software defaults to a non-local option for its main feature.

0 comments

Somehow, in the AI world, "local-first" means a local harness talking to a remote model, almost never "local harness talking to local model". But then "open source model" apparently also means "you can download the weights if you agree to our license" and almost never "you can see, understand and iterate on what we did", so the definitions already drifted a lot between the two ecosystems.

kenforthewin16d ago

Atomic supports any generic openAI compatible LLM provider, including ollama, LM studio, etc.

embedding-shape16d ago

But local-first !== defaults to local inference, right?

1 more reply

kenforthewin16d ago

I'm not sure what the dunk is supposed to be here .. Atomic supports the exact same feature set with local models as it does for OpenRouter. Is your gripe just that Openrouter is the first option in the dropdown?

max-privatevoidOP16d ago

Yes. Why even call it local-first when local isn't first? Not to mention, for some reason they decided to only support Ollama instead of giving you the option to connect to any OpenAI-compatible server, which would make this work with any other inference server such as llama.cpp and vLLM as well as Ollama. (and also most SaaS inference providers, including OpenRouter, so the custom integration would not be necessary either, https://schizo.cooking/schizo-takes/9.html)

kenforthewin16d ago

Did you think local-first meant how a dropdown is sorted?

OpenAI-compatible is indeed one of the provider options for Atomic. Ollama and openRouter are separate options to allow for easier selection of models from these specific providers.

1 more reply

Lalabadie16d ago

Yes, hah.

"Local-first, your data never leaves the computer! Except once to go to the biggest information hoarders on the Internet."

kenforthewin16d ago

Atomic supports any generic openAI compatible LLM provider, including ollama, LM studio, etc.

j / k navigate · click thread line to collapse

0 comments

embedding-shape16d ago

kenforthewin16d ago

Atomic supports any generic openAI compatible LLM provider, including ollama, LM studio, etc.

embedding-shape16d ago

But local-first !== defaults to local inference, right?

1 more reply

kenforthewin16d ago

max-privatevoidOP16d ago

kenforthewin16d ago

Did you think local-first meant how a dropdown is sorted?

OpenAI-compatible is indeed one of the provider options for Atomic. Ollama and openRouter are separate options to allow for easier selection of models from these specific providers.

1 more reply

Lalabadie16d ago

Yes, hah.

"Local-first, your data never leaves the computer! Except once to go to the biggest information hoarders on the Internet."

kenforthewin16d ago

Atomic supports any generic openAI compatible LLM provider, including ollama, LM studio, etc.

j / k navigate · click thread line to collapse