As for "holding back the organization", if we're talking about existential risk, I want them to be held back. These people have no business being stewards of any technology that might be an existential risk.
According to Altman and the rest of the OpenAI board, there is. They are the ones sounding the alarm, so they should be judged by the appropriate ethical standards.
