AI Can Find the Code. It Didn't Know How the System Worked (opens in new tab)

Author here: I wrote this article about a failure I had applying LLM to an enterprise codebase, and ran a quick pilot study on a similar repo to understand the failures better.

I'd interested to know, are folks seeing the same things?