Ask HN: If you work at an enterprise, do you use Open Source LLM or GPT?

2 pointsdatacog2y ago2 comments

Question behind the question. I'm building a startup which offers "AI Compute Box", essentially Hardware loaded with a fine-tuned LLM model which will be deployed to enterprises. I am looking to understand whether (a) enterprises install models on their own rack, (b) deploy on AWS/Azure cloud, (c) use private instances offered by offered by AWS or Azure

2 comments

lygten2y ago

Due to privacy issues, I would as a company only ever use a finetuned LLM.

datacogOP2y ago

thanks for your response. would this be an open source fine-tuned?

j / k navigate · click thread line to collapse

Ask HN: If you work at an enterprise, do you use Open Source LLM or GPT?

2 pointsdatacog2y ago2 comments

2 comments

lygten2y ago

Due to privacy issues, I would as a company only ever use a finetuned LLM.

datacogOP2y ago

thanks for your response. would this be an open source fine-tuned?

j / k navigate · click thread line to collapse