Is that really any different than asking me to attempt to program in a moderately obscure programming language without a runtime to test my code on? I wouldn't be able to figure out what I don't know without a feedback loop incorporating data.

>If you point out problems it'll happily try again and repeat the same errors over and over again.

And quite often if you incorporate the correct documentation, it will stop repeating the errors and give a correct answer.

It's not a continuous learning model either. It has small token windows where it begins forgetting things. So yea, it has limits far below most humans, but far beyond any we've seen in the past.