Ask HN: What is the most promising AI tool in cloud ecosystem?

7 pointserkanerol2y ago2 comments

As a platform engineer whose expertise is Kubernetes and Cloud, I am looking for AI tools/projects to learn/try. What projects are on your radar?

I guess many companies will need to run their own LLMs on their k8s clusters and we will see many projects in this area. I want to be early adopter and looking for new projects.

2 comments

kirkmarple2y ago

Have a look at Graphlit (https://www.graphlit.com). Managed cloud-native platform for knowledge ingestion and retrieval. Simple GraphQL API, and serverless backend to handle all the data ingestion, embeddings, and RAG LLM patterns. Free tier to try out without CC. (Disclaimer: I'm the founder)

ianpurton2y ago

We're working on an open source chat gpt that runs on kubernetes. https://github.com/bionic-gpt/bionic-gpt

And you're right many companies are looking at running LLMs in house.

j / k navigate · click thread line to collapse