undefined | Better HN

Skip to content

Top Best Ask Show New Jobs

0 pointssamlinnfer6d ago0 comments

It's being extended breathlessly into an moral issue. User asked for gory images, got gory images. Will someone please think of the non-existent women who could be hurt by this?

0 comments

5 comments · 1 top-level

gacgacgac6d ago· 4 in thread

I don't think you understand the concern. Or at least nothing you've communicated suggests you understand it.

ChatGPT should never produce images like this. Full stop. Prompted or not, it should refuse. Now we know it's possible to walk around the gate and get it to comply. Are there other, genuinely harmful images that it should never produce? Deepfake revenge porn? Images of specific people being brutalized? I'd argue those absolutely can be harmful to someone. Well now there's evidence the "never produce this" wall can be overcome. It's only a matter of time before genuinely harmful imagery is generated.

samlinnferOP5d ago

It may be harmful to someone if shared and sent with malicious intent, but more damage has been done with pens, keyboard and words. Start banning pens that let people write hurtful things next. Ban Photoshop after because someone can get hurt with a manipulated image.

gacgacgac5d ago

If you think these tools are remotely comparable, you haven't been paying attention.

andsoitis6d ago

> ChatGPT should never produce images like this. Full stop. Prompted or not, it should refuse.

Why not?

gacgacgac5d ago

Because the company has said they won't. I'm not making a value judgement about what images should exist here, I'm making a "the company said it shouldn't be capable of producing that output, then it does" argument. Thats a bug.

j / k navigate · click thread line to collapse