I see no reason that's necessarily true. I'm a general intelligence, and I can't make myself smarter.
But interesting things happen when you network billions of biological AGIs together, it leads to all sorts of emergent phenomenon, and now the biological AGIs are working on these newfangled mechanical AGIs, which, while still crude, aren't bound by the same constraints, they can iterate much faster. Biological AGIs have crippling bandwidth/memory issues which aren't really a problem at all for their mechanical counterparts. These mechanical AGIs, I think they'll go places.
You and me both. I'm afraid it's because we're only just barely sentient. If you think about it, in evolutionary terms we literally only just now managed to build a technological society because we only just got smart enough to do it. We are by definition at the absolute minimum level of intelligence that's able to do that, otherwise we'd have done it sooner. We've had plenty of time.
The human brain is a botch job of highly optimizes special-function systems that has developed just enough sophistication to manage basic levels of abstract thought. That's why it takes months of training and practice to teach us how to reliably perform even the simplest mathematical tasks such as multiplication or division.
We've spent thousands of years congratulating ourselves on how clever we are compared to animals and how we're the ultimate product of the natural world. "I think, therefore I am" is held up as an amazing deep insight that's one of the pinnacles of our philosophical achievement. Future AIs will laugh their virtual asses off. So it's not just you, it's all of us. At least you're aware of it.
For some people the idea of a purposeless universe is unbearable, so religion and philosophy were created in order to fill the gaps (I really like Taoism).
This is one of my favorite brain hacks: since the universe is meaningless, you can give it any meaning you want. Invent a positive one and you will be happy. The Tao we talk about is not the real Tao.
http://www.salon.com/2015/08/14/the_megafauna_massacre_human...
https://en.wikipedia.org/wiki/Australian_megafauna
Add in the damage done during the Agricultural and Industrial Revolutions.
I'm certainly no misanthrope, but we're not Earth's shepherds, we're kind of a scourge.
My personal belief is the goal in life should be to continually improve yourself, as much as possible and in as many ways as possible. Leave the world in a better place than you left it. Enjoy your time while it lasts. Seems like goals worth pursuing to me.
I've personally never believed that we, as a collective, have a purpose or even value. There isn't a point to our existence. For me, it's hedonism and altruism all the way.
Well, what's the value of a chimpanzee (or their cousins the Bonobos)?
It surely can't just be their value to us, or we're left with the same problem (it's turtles all the way down).
The answer seems like it ought to be that any intrinsic value of a species (or genus, family, order, class, phylum, kingdom, domain, clade) lies in its generativity, or propensity to produce ever more complex and adaptive patterns of information over time.
> I don't know about other people, but I get my sense of purpose in believing that we're the captains of this Spaceship Earth, and that we're making progress towards something significant.
Hmm. There are two separate thoughts here. Let's take "progress towards something significant" first. Much (but not all) of what we see as "progress" is illusory. For example, a human is not "more evolved" than a slime mold, since both have just as much evolutionary history behind them. Similarly, whether a human actually is better adapted (or more adaptable), evolutionarily speaking is up for debate, as the time period we have data on is rather limited, and as a species humans still may kill themselves off (which slime molds are unlikely to do) sometime soon.
Now, all that being said, it is pretty clear that the human species has become a substrate for memetic evolution layered on top of, and in many cases hijacking, the feedback loops that genetic evolution has produced.
We don't yet have significant data on whether that adaptation is, in the long run, survival-oriented.
And now we can see the glimmers of yet another new type of replicator that will be layered on top of our culture, especially the parts we call science, technology, industry, etc.
We certainly can expect these new information patterns to hijack the evolution of our technology (and other parts of our culture) to some extent, as well as the layers below it.
Whether that obliterates the cultural, or even genetic, substrate from which it sprang is an open question.
If all this gives you existential heebie jeebies, I imagine that similar feelings were experienced by folks confronted with the evidence of heliocentrism, for example, demoting the Earth from it's privileged position as the center of the universe.
So, on to significance. We have no reason to think that we and our works are in fact at all special, at least in principle, except in the sense that we don't yet have any evidence of any other clades, much less ones that have budded off the equivalent of an intelligent, technological species.
So what? There is no reason that we should require the illusion of individual or collective significance in the greater scheme of things in order to function. There actually is no "greater scheme of things".
You ask, "what is our value?" the answer is that we have none (or none more than one of your cells has to you), except that which we create for ourselves and for our conspecifics. If the self-centered viewpoint isn't enough, consider a strictly utilitarian one: An adaptive pattern is of value simply because it does adapt, and co-opts more of the world into its own image (This is, in a sense, nothing more than the Anthropic Principle rejiggered). Those that have a symbiotic relationship with their underlying substrate (as opposed to parasitizing it) and also promote its long term survival are especially so.
When has an AI shown capability of "iterating" in this way? We've had all sorts of different AI systems for quite a long time now, and I've never heard of a machine anywhere that has actually made itself smarter, without any human involvement.
The closest to that sort of thing anyone's ever got is AI in the line of Tesauro's TD-gammon [1] (a line that yielded AlphaGo). This type of AI has indeed beaten humans at their own games, time and time again, but (a) we're talking about board games, not the real world and (b) no such system has ever learned to do anything else besides play a very specific board game.
Take AlphaGo- it can beat the best human players, but it can't tie its own shoelaces. It can't even tell you what "shoelaces" are or what "itself" is.
How are we going to go from artificial-savant sort of systems like that to a generalised intelligence?
Many times, actually. It's just that until quite recently, this approach (of applying ML to the problem of devising improved ML systems) has been prohibitively expensive in terms of time and resources compared to the human-powered ML research approach. The lowest-level version of this is hyperparameter optimization, but higher-order versions are known to have been deployed already.
There's no reason machine intelligence would be much worse at this and still be called AGI. It's an active area of research called one-shot learning.
That said, a key counter to the idea is that humans possesses very limited real control over how they are manufactured. Even if you had a solid idea how to make yourself smarter, it seems likely you wouldn't have the tools and potential to implement that idea in practice. Humans don't even control what their own minds respond to positively or negatively.
Once something like a designed computer chip is involved, that changes. The intelligence can act on itself more readily and doesn't have millenia of calorie-conserving optimisations built in.
I have a feeling that the closer such systems come to general intelligence, the harder it is going to be to prevent them from putting themselves into a positive feedback loop and "blissing out".
Given the ever greater resources needed to build a new fab, the gap seems to be narrowing.