akiarie

LLMs may theoretically be able to generate millions of correct lines of code.

But for any important code the only way to know that it's correct is to hand-audit every line, which is harder than writing every line because this allows you to build a conceptual hierarchy and model within which you can think about the code.

So there's a fundamental limit to the speedup from LLMs when writing anything you care about.

(The main objection will be what about when you have a human engineer working on your behalf. But this is a distraction: sometimes you can fully trust an engineer, which is not at all true for LLMs.)

Call me a snowflake, but I propose that those of us who don't believe that AI is actually intelligence look for a term to refer to its "thinking" that isn't "intelligence", because this helps our weak minds keep things straight.

subligence /sʌbˈlɪdʒəns/ n.

A lesser or rudimentary form of intelligence; the capacity to respond, select, or adapt without full understanding. The semblance of mind in animals, machines, systems, or inanimate things. Discernment beneath reason; inferior intelligence.

Example: "Since December, the coding models have gotten noticeably more subligent, so much so that the undiscerning eye has trouble distinguishing their output from human intelligence."