If it's not running locally, then by nature of what an LLM is it cannot be private.
LLMs cannot act on encrypted information - the server must have access to all your plaintext prompts. And you simply are forced to trust they don't keep them forever, but they probably do.
