Yes, but they deprecate old checkpoints very fast.
You also can’t ever use the original version that wasn’t aligned to Sam Altman’s preferred vision.
By all accounts there is an “alignment tax” that reduces the capability of these systems.
For industrial or large scale public use I would also argue for the well-behaved models to be the only ones used.
For personal experimentation I prefer a sassy AI that tells me I’m wrong. Sam insists I’m too immature and I can’t be entrusted with making that choice for myself.