If we want reproducible output we already have conventional software. Stop using a hammer on screws.

So it's like humans then

This is wrong for all LLMs which have a temperature setting.

And even if there were guaranteed to be non-deterministic, there is still lots of value in many aspects of content generation.