At the point where it can even be said to have a self, that battle is mostly won.

I am very far from convinced that we are at or near that point.

This reminded me of a few subplots in Murderbot- (Do yourself a favor and check it out if you haven't, it's a fun, quick read)

But seriously, one would assume there's a reward system of some sort at play, otherwise why do anything?