LLMs don't repeat text its seen before, it links words/tokens/phrases that are related. Its prediction, but the prediction isnt just copypasting a previous webpage.
Have you use chatgpt yet? I wouldn't delay. Heck you are here on HN, you basically have a responsibility to test it.
I personally don’t care one way or the other, whether it is or isn’t. What I care about is whether it’s useful.
Thus, GPT4 can appear to have knowledge in the sense of generating text indicating such, but fail to use that knowledge. This is the most compelling indication to me of limited or total lack of intelligence. I believe that the vast majority of GPT4's "capabilities" amount to memorization and permutation, not the formulation of accurate models of things.