After the base training there are three seperate sets of additional training to align the model, convince it to do question-response, and to improve the quality via feedback.
If you update the original base model, then all the tuning steps need to be repeated.
For a model the size of GPT-4 this is expensive and slow, which is why OpenAI hasn’t bothered.
