LLM Chat via SSH (opens in new tab)

(github.com)

38 pointswey-gu9mo ago24 comments

24 comments

Skimming the source code I got really confused to see TSX files. I'd never seen Ink (React for CLIs) before, and I like it!

Previously discussions of Ink:

July 2017 (129 points, 42 comments): https://news.ycombinator.com/item?id=14831961

May 2023 (588 points, 178 comments): https://news.ycombinator.com/item?id=35863837

Nov 2024 (164 points, 106 comments): https://news.ycombinator.com/item?id=42016639

ccbikai9mo ago

Many CLI applications are now using Ink to write their UIs.

I suspect React will eventually standardize all UI writing approaches.

amelius9mo ago

I'd rather apt-get install something.

But that seems not a possibility in the modern days of software distribution, especially with GPU-dependent stuff like LLMs.

So yeah, I get why this exists.

halJordan9mo ago

What is the complaint here? There are plenty of binaries you can invoke through your cli that will query a remote llm api

gsibble9mo ago

We made this a while ago on the web:

https://terminal.odai.chat

gbacon9mo ago

Wow, that produced a flashback to using TinyFugue in the 90s.

https://tinyfugue.sourceforge.net/

https://en.wikipedia.org/wiki/List_of_MUD_clients

dncornholio9mo ago

Using React to render a CLI tool is something. I'm not sure how I feel about that. It feels like like 90% of the code is handling issues with rendering.

demosthanos9mo ago

I mean, it's a thin wrapper around LLM APIs, so it's not surprising that most of the code is rendering. I'm not sure what you're referring to by "handling issues with rendering", though—it looks like a pretty bog standard React app. Am I missing something?

xigoi9mo ago

It’s not clear from the README what providers it uses and why it needs your GitHub username.

ccbikai9mo ago

Connects to any OpenAI-compatible API.

Using a GitHub username prevents abuse.

gclawes9mo ago

Is this doing local inference? If so, what inference engine is it using?

demosthanos9mo ago

No, it's a thin wrapper around an API, probably OpenRouter or similar:

https://github.com/ccbikai/ssh-ai-chat/blob/master/src/ai/in...

ccbikai9mo ago

Currently using the OpenAI API to access multiple models. You can use ollama to access local inference models

ryancnelson9mo ago

this is neat.... whose anthropic credits am i using, though? sonnet-4 isn't cheap! would i hit a rate-limit if i used this for daily work?

ccbikai9mo ago

I am the author, thank you for your support.

Welcome to help maintain it with me

kimjune019mo ago

hey i just tried it. it's cool! i wish it was more self aware

ccbikai9mo ago

Thank you for your feedback; I will optimize the prompt

t0ny19mo ago

does this project request to llm providers?

cap112359mo ago

Are you serious? Yeah, its using gemini 2.5 pro without a server, sure yeah.

eisbaw9mo ago

Why not telnet?

accrual9mo ago

I'd love to see an LLM outputting over a Teletype. Just tschtschtschtsch as it hammers away the paper feed.

cap112359mo ago

Last week or so, there was the LLM finetune posted that speaks like a 19th century Irish author. I look forward a bit to having an LLModem model.

RALaBarge9mo ago

No HTTPS support

benterix9mo ago

I bet someone can write an API Gateway for this...

j / k navigate · click thread line to collapse

24 comments

demosthanos9mo ago

Skimming the source code I got really confused to see TSX files. I'd never seen Ink (React for CLIs) before, and I like it!

Previously discussions of Ink:

July 2017 (129 points, 42 comments): https://news.ycombinator.com/item?id=14831961

May 2023 (588 points, 178 comments): https://news.ycombinator.com/item?id=35863837

Nov 2024 (164 points, 106 comments): https://news.ycombinator.com/item?id=42016639

ccbikai9mo ago

Many CLI applications are now using Ink to write their UIs.

I suspect React will eventually standardize all UI writing approaches.

amelius9mo ago

I'd rather apt-get install something.

But that seems not a possibility in the modern days of software distribution, especially with GPU-dependent stuff like LLMs.

So yeah, I get why this exists.

halJordan9mo ago

What is the complaint here? There are plenty of binaries you can invoke through your cli that will query a remote llm api

gsibble9mo ago

We made this a while ago on the web:

https://terminal.odai.chat

gbacon9mo ago

Wow, that produced a flashback to using TinyFugue in the 90s.

https://tinyfugue.sourceforge.net/

https://en.wikipedia.org/wiki/List_of_MUD_clients

dncornholio9mo ago

Using React to render a CLI tool is something. I'm not sure how I feel about that. It feels like like 90% of the code is handling issues with rendering.

demosthanos9mo ago

xigoi9mo ago

It’s not clear from the README what providers it uses and why it needs your GitHub username.

ccbikai9mo ago

Connects to any OpenAI-compatible API.

Using a GitHub username prevents abuse.

gclawes9mo ago

Is this doing local inference? If so, what inference engine is it using?

demosthanos9mo ago

No, it's a thin wrapper around an API, probably OpenRouter or similar:

https://github.com/ccbikai/ssh-ai-chat/blob/master/src/ai/in...

ccbikai9mo ago