I think I agree with those points. However, the most interesting thing about GPT-3 in my mind is how it was largely a naive scaling up of GPT-2.
I would be very surprised to not see a GPT-4-like system built in the next several years by simply scaling up by 100x again (perhaps with some algorithmic improvements thrown in as well). I don’t know how it will perform but I expect it to be significantly more impressive than GPT-3. Which would be a very interesting thing... the world would look very different. Potentially even scary, especially with immediate follow-up reapplications of the techniques in other areas.