Nobody is putting these huge models in production, even the smaller transformer models are still too expensive to run for most use cases.
With the way the field is moving, GPT-3 will be old news in a month, when more advances are made and open sourced.
