I can ask for hyperspecific questions, ask one-line questions, ask it to generate code to do a very specific thing, and ask follow up questions. I can literally ask it to do my homework if I wanted to - though that is of limited use when you actually have to maintain the thing. At best "doing the work" is really just getting an example to get started.
Like Stackoverflow, you get more value if you ask a good question. I need enough expertise to ask a question to get started.
Does it always work? No. Does it completely get rid of Google? No. But it does work about 90% of the time. That's probably better than random stuff I find online :) We should carry skepticism at all times, regardless of the search.
Where is Google better / more useful?
* Getting to actual docs, straight from the horses mouth, with no hallucinations :)
* Looking for authority or social proof (What Stackoverflow or Reddit answers are highly voted, linked to, considered authoritative)
* Get the latest info - more up to date than the LLM's training data. ChatGPT will sometimes give me a version that worked several years ago, but doesn't work now.
Google is better at retrieving to things-about-the-knowledge; ChatGPT is better at synthesizing and presenting knowledge
All in all, it doesn't replace me, but creates a very seamless experience of researching, learning, and taking the next step.
This is the sweetest thing about ChatGPT.
With Stack Overflow, if I ever have the misfortune of needing to ask a question, I feel like I'm a contractor with some seriously constraining contractual obligations. I feel like I'm serving them rather than them serving me. I have to perform an exotic dance through a field of eggshells just to get what I'm after.
With ChatGPT, I feel the opposite. I feel like it's really serving me. It's so refreshing to just be able to ask any kind of question, any follow-up questions, no strings attached.
Even beyond Stack Overflow, with forums and message boards in general, I no longer have to deal with moderators locking my post, users reprimanding me for not using their atrocious search feature, no whining or rhetorical judgements "why would you even want to do this, you stupid idiot?"
That said, the effectiveness of ChatGPT wouldn't be what it is without Stack Overflow question martyrs and their answerers.
I used it the other day to help me with graph drawing in a Jupyter notebook the other day. It certainly felt faster than searching with google or sifting through docs just to find the right functions to call.
I also see it fail miserably on other programming tasks.
