Yeah it's a bit silly to act like this is all marketing fluff when the actual product is released to the public and we can all compare it to results of GPT3.5.

A mining company protecting access to the gold mine is different than a company with a fools gold mine limiting access to the mine to delay analysis.

There might be an "empty chassis" in the academic paper but that's different than tech companies betting on their closed sourced licensing/marketing to spin something less-than-whole.

People have, and it gaslit them into thinking it was 2022

I believe they will be replicated outside OpenAI, given enough time. But the fewer details OpenAI releases, the longer it will take for someone else to replicate them.

To your second question, I am worried about the power dynamics of one lab having a monopoly on super-powerful models. But by far the worst risk I'm worried about (and it's my job to try and help mitigate) is catastrophic accidents from someone creating a super-powerful model without the right alignment techniques and safeguards. And that kind of risk is heightened when there are more actors competitively racing to build AGI.

> But you can see with your own eyes that it does in fact, work.

I can't tell if the answers of the tool are objective or if the answers aren't biases by the training corpus (or some collective bias ingrained within the training corpus). I really can't tell much about it. It's very much a black box - take it or leave it.

I think that's a great deal.

I mean science is all about objectivity (or so i was told)

Without accounting for data and model architecture, it’s not a very useful number. For all we know, they may have sparse approximations which would throw this off by a lot. For example, if you measure a fully connected model over images of size N^2 and compare it to a convolutional one, the former would have O(N^4) parameters and the latter would have O(K^2) parameters, for K<N window size. It’s only useful if you know they essentially stacked additional layers on top of GPT3.5, which we know is not the case as they added a vision head.