The mechanical Turk did something truly magical. Everyone stopped moaning that automation was impossible because most machines (while some absurdly complex) were many orders of magnitude simpler than chess.
The initial LLMs simply lied about everything. If you happened to know something it was rather shocking but for topics you knew nothing about you got a rather convincing answer. Then the arms race begun and now the lies are so convincing we are at viable robot overlords.