Ask HN: Hosted LLMs to process personal data?

1 pointsyboulkaid1mo ago0 comments

There are some good use cases for LLMs to process personal data (think paperless-ngx document scanning or semantic search for personal photos). However, this data should never be saved for future training as it's highly sensitive.

It's not always convenient to self-host LLMs as you'd need a beefy and costly GPU.

What's the best way to have access to good models with the guarantee that your datw won't be touched? AWS Bedrock? Self-host on an EC2 instance? Huggingface Pro?

0 comments

No comments yet.

Ask HN: Hosted LLMs to process personal data?

1 pointsyboulkaid1mo ago0 comments

It's not always convenient to self-host LLMs as you'd need a beefy and costly GPU.

What's the best way to have access to good models with the guarantee that your datw won't be touched? AWS Bedrock? Self-host on an EC2 instance? Huggingface Pro?