There are some good use cases for LLMs to process personal data (think paperless-ngx document scanning or semantic search for personal photos). However, this data should never be saved for future training as it's highly sensitive.
It's not always convenient to self-host LLMs as you'd need a beefy and costly GPU.
What's the best way to have access to good models with the guarantee that your datw won't be touched? AWS Bedrock? Self-host on an EC2 instance? Huggingface Pro?
