Ask HN: Suitable LLM models for an agent for user guides and docs?

2 pointsmingyeow2y ago1 comments

Hi, i would like to implement an AI agent for my user guides and wiki (about 100 pages), so users can easily come in and interact with it. I expect the amount of content to increase quite a lot over time.

I would prefer it to the model to be self hosted, so I dont worry about how much APIs cost etc. My website content will be relatively small for a long time.

1 comments

runjake2y ago

Start playing with stuff like llama. You'll have to code it yourself.

https://sych.io/blog/how-to-run-llama-2-locally-a-guide-to-r...

j / k navigate · click thread line to collapse

Ask HN: Suitable LLM models for an agent for user guides and docs?

2 pointsmingyeow2y ago1 comments

I would prefer it to the model to be self hosted, so I dont worry about how much APIs cost etc. My website content will be relatively small for a long time.

1 comments

runjake2y ago

Start playing with stuff like llama. You'll have to code it yourself.

https://sych.io/blog/how-to-run-llama-2-locally-a-guide-to-r...

j / k navigate · click thread line to collapse