apples private cloud compute can get close, its still not 100 safe because backdoors and crypto breaks are possible but you go from trusting the data center operator with all their employees to only the person thats inspecting new hardware and giving out certificates (apple in this case). if some well known non profit like mozilla or isrg starts doing it with full open source software its like the best possible security

That is completely obvious, it’s like saying “100% security does not exist”.

I believe you are falling into the nirvana fallacy: No shades of grey, if it’s not perfect it’s as bad as the rest.

This is a very inefficient way of thinking as it is not possible to self host everything for most people, it just demands too much time.

Hence its is a perfectly valid approach in my opinion to looks at better (or, very often, “less worse”) SaaS solution.

If they states ZDR on a model, the likeliness of it leaking less data to some LLM data training is higher simply. If the business model of a company is built around a differentiator which is data privacy, that also significantly increases probability that data is not being leaked/sold.

It’s all grey, relative and about probabilities. Nothing’s perfect – another captain obvious thing.

Just like most things in life the guarantee it based on the entity/person providing said guarantee.

I can host a LLM in my basement and guarantee it, but would you trust me? Now you can say that you don't trust any company, but B2B relies on counterparty risk.

Confidential inference gets us closer (via Nvidia's TEE architecture)