As a person that has been futzing with "AI" since early expert systems, I can give a little bit of background on the evolution of the term of art 'artificial general intelligence' Back in the days of lisp machines and expert systems, we started playing with early neural networks in an attempt to advance towards 'general intelligence' rather than the highly constrained talents of expert systems.

At that time, general intelligence was imagined like what a mouse, dog, or cat has, in varying degrees. (it was then broadly thought that insects and other "simple" organisms worked from instinct and conditioning only) So intelligence was broadly imagined to be the ability to reason through an arbitrary problem with a combination of insight and trial and error. It had nothing at all to do with reaching human levels of competence.

Gradually, the bar for AGI has slipped skyward to assume human level competence. I think that part of that was because we actually started checking boxes for tasks that were thought to represent "true" AI....

...But then we recognized that nope, it is not yet generally intelligent, it can just easily and accurately do (X task which was thought to require intelligence but really was only pattern matching or stochastic prediction). So, we raise the bar above task X and trivialize it as being less important than we thought.

Meanwhile, -nearly every task- that we thought would represent "true intelligence" has fallen not to some magic AI algorithm, but rather to stochastic models like transformers, pattern matching, or straightforward computation. With no reason to expect otherwise, I expect this trend to continue unabated.

So, what I'm saying is I have come to doubt that there is some secret sauce in "intelligence", but instead believe that "intelligence" is a blend of competencies enabled in animals by specialization of neural computational structures, "REPL" loops, goal seeking behaviors, and other tidbits which will be more of a slog than a eureka. I don't think that LLM's will create human-level intelligence on their own, but I do think that they will be an important component.

I also think that surprisingly, transformers all by them selves exhibit a flaky variety of general intelligence, and they are proving effective in robotic applications (though without a supervisory agent I suspect they will frequently go off the rails, so to speak.)

My original point was more that we expect machine general intelligence to be spectacularly useful. It may be, someday, but it is a kind of fallacy to think that "its not that useful therefore it must not really be intelligence".

Small animals also have limited utility, but with given names, language, tool use, and problem solving skills I think arguing that they do not exhibit "intelligence" would be a tough sell for me.

By my observation, we have made giant leaps in the past 15 years, and we now have perhaps the vast majority of the components required to make artificial general intelligence...but it won't necessarily be all that useful at first, except maybe as a "pet robot" or something like that. Even if we scale it, it might not magically get smarter, just faster. a million hyper-speed squirrels still has a very limited level of utility.

From there, we will incrementally improve if we don't stumble too hard over ourselves on any number of pressing obstacles that we currently face, until we finally succeed in doing what we were apparently born to do - to construct the means of our own irrelevance. Evolution at work, I suppose.