My understanding of the models and linear algebra combined with my experience of their performance improvements make me think he’s likely right. We have some people wanting to pooh-pooh these machines. They will point to current limitations of the models and weak spots as though the underlying mode of the design rather than the current implementation is the limiting factor. They act as though real intelligence is always right.
I have been wrong before but I am pretty convinced. Everyone’s arguments against it happening is that it hasn’t yet happened.
No one knows what’s on the other side of AI being a better AI researcher than humans.