It's a static web app, you can host it yourself, data is stored locally on your browser, API requests are made directly to OpenAI API without any middle server.
It has some more convenient features that make your that experience way better. Like search chat history, prompt library, integrations, etc.
Would love to hear all the feedback!
Note for anybody else wondering, it's not open source, you have to download a binary. More FAQ by clicking the Gift (?) icon at the top and scrolling down.
I’d assumed ChatGPT’s slow-typing was actually the model’s real-time output, streamed to the browser token-by-token. When I’ve made GPT3 API calls it’s worked like this, with streaming switched off I might need to wait ~20 seconds for a long response back.
I just tried your UI, and it’s so much faster! Was my assumption about real-time output wrong?
Great project, looking forward to using it more :)
It's basically doing the same thing. I found that using API keys is also significantly cheaper than using the subscription with moderate usage.
Congrats on the release.
Can already see the whisper model makings its way through the product :)
Edit: However, as typingmind is earning more than $1000, it should have more features and better maintenance.
That would be great, something like a button\action with a promt that would load and split if needed large amounts of text and promt it in conversation. (maybe add format some parsing, like markdown or plain text)
Also would be great to see which messages are included in the computation, since chat gpt limits total characters per request to 4K? so inevitably some past messages will be rendered useless.
Overall well done!
As per your question, currently all the previous messages of the same chat will be included in the request. If you hit the 4k token limit, there will be an error message. I'll look into improving this too.
https://github.com/kierangilliam/chatwithme.chat
Available at: https://www.chatwithme.chat/
One possible improvement: I had accidentally mistyped my API key and it popped up an HTTP 500 error instead of going "That doesn't seem to be a valid API key, could you make sure you pasted it in correctly" or something...
https://www.reddit.com/r/OpenAI/comments/11ef8ea/superpower_...
One feature I would love is passing a prompt (or even a conversation) using queryparams. It would help for the integration with other tools.
Another feature I'd love is to exploit the 'system' agent. From the documentation, there are three possible agents : User, Assistant and System. My understanding is that system can be exploited to drive the expected general behavior of the assistant and seems very useful to that regard.
Last thing, if it was open-source I could clone it and that would dismiss any fears from having my API key stolen. But that's up to you of course.
If this UI can capture my query in the case of such a crash and keep retrying till I get the answer, and then notify me (browser, email, etc) - that would be great.
[1] https://twitter.com/adamdangelo/status/1631714221171023873
Add serpapi on top of that, and you might just become my phone’s most used app.