In my opinion the field is not that rapidly advancing. The major breakthroughs, where something was really much better than everything before were the following:
GPT-2 February 2019
GPT-3 June 2020
CPT-3.5 December 2022
GPT-4 February 2023
Note that GPT-3 to GPT4 took almost 3 years!
