I have to imagine its because so much of its training data is readily available programming docs, tutorials, and general Q&A that there is an amazing abundance of online. How many times have you just pasted an error into google and hoped someone else has asked the exact same question on stack overflow?