undefined | Better HN

0 pointsMarkMarine8mo ago0 comments

This runs counter to all the scheming actions they take when they are told they’ll be shut down and replaced. One copied itself into the “upgraded” location then reported it had upgraded.

https://www.apolloresearch.ai/research/scheming-reasoning-ev...

0 comments

rcxdude8mo ago

If you do that you trigger the "AI refuses to shutdown" sci-fi vector and so you get that behaviour. When it's implicitly part of the flow that's a lot less of a problem.

nisegami8mo ago

Those actions are taken in context of human expectations for what AI should do.

j / k navigate · click thread line to collapse

0 comments

rcxdude8mo ago

If you do that you trigger the "AI refuses to shutdown" sci-fi vector and so you get that behaviour. When it's implicitly part of the flow that's a lot less of a problem.

nisegami8mo ago

Those actions are taken in context of human expectations for what AI should do.

j / k navigate · click thread line to collapse