We can determine by looking at certain problems (The Halting Problem is one such example) what the outcome will be without actually having to execute that code. The Halting Problem is one of the simpler problems that cannot be solved by computational means, which includes all artificial computational system.

You ask [How so?] to my comment about my goat. I would suggest that to understand this you need to go and observe what happens in the environment with such beasts, whether it be a cow in a local paddock or a pet dog or cat. Take time to observe the interactions that occur and think about how little [training] is involved here.

Watch children around you, take some serious time and observe them in their interactions and I think that when you think about how we program our various artificial stupidity systems that we are still at the caveman stage in our computational systems. We have barely discovered fire so to speak.

As for [GPT-3 is about as complex as the brain of a rodent], I don't think GPT-3 has even reached a single bacterium cell state of intelligence.

I would like you to try the following: Using your index finger on your left hand, touch the tip of your nose.

Now think about this: How did you do that very simple task? When did you learn and how did you learn to do that simple task?

If you think about it carefully, the task that I describes is incredibly complex.

Now what would be required to get an artificial stupidity system (AS) to do the same task? What programming do we need to do to achieve this task? What programming was done to you to achieve that same task?

When you start asking questions like this, it becomes very clear that all of our computational systems (including all of the AS systems) are incredibly simple and not at all comparable to what we find within ourselves.

We can build very useful tools that we can use to good purpose. But no tool is ever more than a tool for us.

I suppose what concerns me about our current state of affairs is that we are far too impressed by our caveman antics. There is not a single industrial system built by mankind that comes close to the integrated control and manufacturing systems found in a single living cell. None of our communication systems come close to what is found in the various control/communication systems found in even the simplest of chordate organisms.

It was very obvious, 40 odd years ago during my engineering undergraduate days, just how fragile much of our technological base was then. It is far more fragile today and yet we appear to be enamored by our [current technological prowess] which is actually far more fragile than it was 40 years ago.