undefined | Better HN

0 pointssalawat4y ago0 comments

There are only so many ways features can be permuted. The I'll defined nature of NN's requires the manuals step because of a neural hash collision.

My challenge to you is this: what stops this system from being abused for non child pornography purposes?

The answer is: nothing. That's what has people's knockers in a twist. It is a backdoor, invisibly crafted, waiting to be subverted by an abusive power that manages to get into an advantageous enough position.

Arguing that Apple's algorithms are fine misses the point. The behavior should not exist.

0 comments

zepto4y ago

> what stops this system from being abused for non child pornography purposes

You are changing the subject. That challenge has nothing at all to do with the OP’s false claims. They are still false.

Someone who can poison the database can indeed match non-child abuse images. The safeguard against that is that both Apple and NCMEC would need to conspire. This mechanism does not prevent such a conspiracy.

> Arguing that Apple's algorithms are fine misses the point.

Who is arguing that they are ‘fine’? I’m simply pointing out that they are not vulnerable in the way the poster claims them to be.

The images they have posted will not trigger the system.

If you want to debate the ethics of other aspects of what Apple is doing, there are plenty of threads elsewhere. This thread is about a false claim about a vulnerability in the system.

False claims about the vulnerabilities don’t help us to reason about what the risks actually are and detract from the moral or ethical debate.

j / k navigate · click thread line to collapse