undefined | Better HN

0 pointssrslack3y ago0 comments

I spent my entire high school years immersed in science fiction. Gibson, Egan, Watts, PKD, Asimov. I have all of that and more, especially a Foundation set I painfully gathered, in hardbound right next to my stand up desk. I can imagine it, did and have imagined it. It was already imagined. Granted, we're not talking about X-risk for most of these. But it's not that large of a leap.

What I take issue with is the framing that a superior cognitive, generalized, adaptable intelligence is actually possible in the real world, and that, 100 years from now even if it is possible, that it's actually a global catastrophic risk. Let's take localized risk, we already have that today, it's called drones and machine learning and war machines in general, and you're focusing on the absolute theoretical X-risk.

0 comments

3 comments · 1 top-level

concordDance3y ago· 2 in thread

> What I take issue with is the framing that a superior cognitive, generalized, adaptable intelligence is actually possible in the real world,

This is an odd attitude to take. We know it's possible because we have had exceptional humans like Albert Einstein, some were even polymaths with a broad range or contributions in many domains. Do you think peak humans are the absolute limit on how intelligent anything can become?

srslackOP3y ago

So, my take is "according to our current understanding" and "artificial". Was a bit distracted. Now, theoretically, is it possible that an alien probe beaconed this solar system 3 billion years ago to a much more advanced civilization and next year they'll arrive and subjugate us and destroy us for that sweet, sweet real estate that's sulfur-poor (as it turns out, their biology is not amenable to it).

Now, is that probable?

No, I don't think humans are the limit. We're apes banging rocks together. Now whether those rocks will be better than us, generally intelligent and (this is important) adaptable is what I doubt.

NumberWangMan3y ago

I hope you're right. I worry that we'll get it done, though. I hope it turns out that energy requirements and the difficulty in scaling are enough that it gives us time to figure out how to align them properly.

One big question in my mind is, we can clearly train narrow AIs that are WAY more capable than us in that narrow area. We started with calculators, then on to chess engines, Go, Starcraft, and right now we're at GPT-4. How is GPT-4 better than humans, and how is it lacking?

Ways it's better: it's much faster, has perfect English grammar, understands many languages at a passable level but not perfectly, has much more knowledge.

Ways it's about the same: it can code pretty well, can solve math problems pretty well. Has the theory of mind of about a 9-year old in tests, I think? It can learn from examples (that one is pretty big, in my opinion!). It can pass a lot of tests that many people can't -- some of this is due to having a lot of book knowledge baked in, but it definitely is capable of some reasoning.

Ways it's worse: it has trouble counting, confabulates, gets distracted. (note that humans also get distracted and confabulate sometimes. We are definitely better at counting, though).

Also, there are some areas that humans handle that GPT-4 just can't do. By itself, it can't talk, can't process music, has no body but if it did it probably would not have any motor control to speak of.

I think we should be wary of is to be hyper-focused on the ways that GPT-4 falls down. It's easy to point at those areas and laugh, while shrugging off the things that it excels at. There's never going to be an AGI that's equivalent to a human -- by the time it's a least as good as a human at everything, it will be beyond us in most ways.

So I expect that if the trend of the past 5 years continues but slows down to half speed, we'll almost certainly have an AGI on our hands sometime around 2030. I think there's a decent chance it'll be superintelligent. Bill Gates says most people overestimate what they can do in 1 year and underestimate what they can do in 10 years, and I think that holds true for humanity as well.

By 2040 or 2050? I really hope we've either solved alignment or collectively decided that this tech is way too dangerous to use and managed to enforce a ban.

1 more reply

j / k navigate · click thread line to collapse