Ask any LLM about the cheese inventors in far East china. It'll make something up very plausible. Then all you have to do is to dig through libraries and historic records to verify that this all really is true and is really rooted in reality.
That's why you are better served asking LLMs for factual information when they are connected to tools like search. ChatGPT with search enabled, Bing.chat or https://www.phind.com/ will give you sourced and much more reliable output.