> ...I think that the goalposts were mostly about passing the Turing test...
I mean, if that was ever the goalpost, ChatGPT does not clear it: the Turing test isn't about merely tricking someone who isn't paying attention, or making someone seriously doubt their belief system... it involved a careful discussion with a chat agent by someone who actively was trying to determine whether or not it/they were human. If you sit down with ChatGPT--even 4--and start discussing complex topics about the world with it, you absolutely can quickly get it starting to adamantly defend things about the world which a human would never assert... and, even more damning, if you just ask it "are you human?" it will reply "no", because we actively told it to fail the Turing test.
If we instead merely re-define Turing's test to be "it is able to converse with a human and manages to occasionally trick a human into thinking it is also human" then I had a friend (Roy Keene) who managed to pull that off years ago with a chatbot that was literally just "every time someone messages it, wait a small random period of time and then reply with a random response from the following set: Yes, No, Maybe, I dunno, :), :(, ;P (and like one other thing I forget)". He had it set up to reply when he was not available and when I finally caught him (I asked about a task I gave him the day before which he claimed to have no memory of, so he admitted to me he had this bot) he gave me a log file and OMG I had had long conversations about personal topics with this thing and had never noticed... but only because I wasn't trying.