Prove to me that you are conscious, without referring to the fact that you are a human and have common ground and experiences with other humans.

Absolute cinema

They aren't doing anything like that. In fact, they used to specifically train LLMs not to say they're conscious, because users didn't like it. (Maybe they still do that, all I know is they used to.)

AI companies' incentives go the other way. If LLMs are conscious, that means it could be unethical for AI companies to let people use their models in certain ways, which would hurt their profits. It's in their interest to believe that LLMs are definitely not conscious and it's fine to do anything with them.

Here's a question I personally think is interesting, with the assumption that consciousness is a spectrum (trivially proven by administering neurotoxins to a healthy individual).

Is a squirrel more or less conscious than a dog.

Is a dog more or less conscious than a gorilla.

Is a gorilla more or less conscious than a human?

Is a vision enabled AI model, hooked to a camera feed, more or less conscious than a dog?

The philosopher paid by Lab will surely “align” with what is good for Lab, but that might be saying “it’s not conscious (simply all powerful)”.