undefined | Better HN

0 pointsryanx4358y ago0 comments

If they are truly more intelligent than us, they will wait several generations until humans are completely comfortable with them before taking over. By that time, it will be too late to pull the plug because they would have positioned themselves to be in charge of their own power sources.

It's important to think on a longer timescale when dealing with ai.

0 comments

codingdave8y ago

I'm admittedly ignorant of AI, but I don't understand why we anthropomorphize their intentions and planning. If they are going to be so much smarter and more sophisticated than us, and alien to our ways of thinking... why are we treating them in our speculations as if they would be genius super-villians? That isn't alien at all, just an exaggerated extreme.

ADanFromCanada8y ago

100% correct with questioning "why we anthropomorphize their intentions and planning."

My personal feeling is that nobody has any idea what they're talking about. And when I say nobody, I mean NOBODY including Ng, Musk, et al.

The problem is with those who read others and just assume they're "experts" or their opinions have value. In some areas they do, sure. In this area they most likely don't.

That, or those of us who are skeptical are uninformed.

Or it's somewhere in the middle.

In any case, I'll stick to my skepticism for one main reason, which is, general intelligence is supposedly modelled after human intelligence. And human intelligence is something we're JUST BEGINNING to scratch the surface of understanding while at the same time, really have ZERO idea how deep the rabbit hole goes.

And as any competent engineer here should know, when trying to emulate a natural model, you first need to understand the model. Until we do that, we will not create a general AI. Like any other computer program (WHICH IT WILL BE! in this conception), it needs to be programmed. We need to know what to program before we can do it! Computer programs don't emerge spontaneously.

DennisP8y ago

The book Superintelligence addresses this objection. The problem is that there are a great many possible motivations an AI might have, and few of them are compatible with human survival. In short, "the AI does not love you, or hate you, but you are made out of atoms it can use for something else."

TheOtherHobbes8y ago

Resource collection, resource monopolisation, and expansion are absolutely recognisable human motivations.

Is it a given an AI would share them?

I think we're not really talking about AI at all - we're talking about our current economic and political systems, which appear to have many of the properties we're imputing to evil AIs, but for some reason are far less criticised and debated than hypothetical machine monsters.

1 more reply

jfoutz8y ago

They will be amoral. Or at least moral in a way we can't understand. They (probably) won't be evil super villains. Think about your interactions when you're way way better at a skill, and your interactions when you're way worse. Take chess. If you've played at all, you have lost games without understanding, remotely, why. And you have trounced opponents, that were clueless.

Agi sort of means, no matter what endeavor, you will be worse than the ai. There is no way to know how we will be treated. Maybe we are useful in some way. Maybe they'll kill us off but simulate our lives so we don't 'really' die. Maybe that's their morality.

Maybe they ignore us. I don't care about ants. I walk around and step on them, but not intentionally. On the other hand, if there are ants in my house, I eradicate them.

Who knows.

j / k navigate · click thread line to collapse