Look at something like [Luncheon on the Grass](https://en.wikipedia.org/wiki/Le_D%C3%A9jeuner_sur_l%27herbe)

This painting was revolutionary. When it was first exhibited in Paris, people were shocked. It was rejected from the Salon (the most prominent art exhibition at the time). Yet, 10 years later, every painting in the Salon resembled it. And you can draw a line from this painting, to Monet, from which you can draw a line to Picasso, from which you can draw a line to Pollock....

Obviously, none of these are totally new innovations, they all came from somewhere. Pattern making.

The only difference between this and these language models is that Manet and artists like him use their rich sensory experience obtained outside of painting to make new paintings. But it's all fundamentally pattern matching in the end. As long as you can obtain the patterns, there's no difference between a human and a machine in this regard.