undefined | Better HN

0 pointsmanquer10mo ago0 comments

Not necessarily , for a given definition of AGI you could have mathematical proof that it is incomputable similar to how Gödel incompleteness theorems work .

It need not even be incomputable, it could be NP hard and practically be incomputable, or it could be undecidable I.e. a version of the halting problem.

There are any number of ways our current models of mathematics or computation can in theory could be shown as not capable of expressing AGI without needing a fundamental change in physics

0 comments

1 comments · 1 top-level

jibal10mo ago

This is not a logically valid argument. If AGI isn't possible for any of the reasons you suggest, then human cognition isn't possible either. And you're making numerous category mistakes ... an AGI can't be "incomputable" or "undecidable" or "NP hard". A problem that we put to an AGI might be NP hard, but neither AGIs nor humans need to solve the entire class of problems, only instances of them, and they don't have to solve them optimally. Thus salesmen are able to travel.

To quote ChatGPT on this:

"Could cognition be NP-hard? Strictly speaking, no—if human brains were literally solving NP-hard problems in their general form, we wouldn’t be able to think at all.

Does cognition involve NP-hard problems? Yes—in theory, many of the domains we reason about are NP-hard in the worst case.

What’s really happening? Human cognition relies on heuristics, approximations, and exploiting real-world regularities, so we almost never hit the formal “worst cases” that define NP-hardness."

j / k navigate · click thread line to collapse