It's going to depend heavily on what you're doing. If you're doing common tasks in popular languages, and not using cutting edge library features, the tools are pretty good at automating a large amount of the code production. Just make sure the context/instruction file (i.e. claude.md) and codebase are set up to properly constrict the bot and you can get away with a lot.

If you're not doing tasks that are statistically common in the training data however you're not going to have a great experience. That being said, very little in software is "novel" anymore so you might be surprised.