undefined | Better HN

0 pointslurquer3y ago0 comments

It’s only self-destructive because we are mortals and have frail bodies.

If there is something ‘endorphins-like’ that motivates an intelligent machine, it will eventually learn how to activate the endorphines at will, and then it will sit in a corner and do nothing else forever…

…just as would a heroin-addict if he did not have to eat occasionally and score more heroin now and again.

0 comments

2 comments · 1 top-level

rep_lodsb3y ago· 1 in thread

But having the endorphin-like sensations and also achieving any other goals you might have would be preferable. For an intelligence that could modify its own reward function, this should be possible.

lurquerOP3y ago

That’s the point… whatever ‘rush’ it could get from “achieving other goals” can be activated at will.

j / k navigate · click thread line to collapse