I don't really understand all the fuss about this particular paper. Nearly all papers on AI techniques are pretty much impossible to reproduce, due to details that the authors don't understand or are trying to cover up.

This is what you get if you make academic researchers compete for citation counts.

Pretraining seems to be an important aspect here, and it makes sense that such pretraining requires good examples, which unfortunately for the free lunch people, is not available to the public.

That's what you get when you let big companies do fundamental research. Would it be better if the companies did not publish anything about their research at all?

It all feels a bit unproductive to attack one another.