I don't think that premise stands. If I ask ChatGPT to write a poem about Sherlock Holmes fighting a mermaid it will happily do so, and I think most users would agree that it'd be a failure mode if it refused.
Isn't it more the case that people are expecting it to sometimes be an artist and other times be a true-fact database, and assuming the AI will know which one they want?
