undefined | Better HN

0 pointsjustinclift15d ago0 comments

> What's the danger?

Hallucinated ideas about what needs doing, what commands to run, etc.

So, data that's no longer reliable (ie could be subtly changed), or even outright data loss.

0 comments

Natfan15d ago

just don't accept bogus changes it suggests? this is why having a human in the loop is a very good idea

justincliftOP15d ago

Yep, I fully agree. It'd be awesome if all (or even most?) of the users were immune to automation bias though. :)

https://en.wikipedia.org/wiki/Automation_bias

And hopefully the users who are using this aren't YOLO-ing it. Though I'm pretty sure we're all expecting there will be a sizeable percentage who are.

j / k navigate · click thread line to collapse