"AI" doesn't actually code, it compiles code snippets downloaded from the Internet. (Basically, it's just Stackoverflow with extra steps.)
Or maybe it will like current laws & regulations, legal code, maybe something like this (first legal code I could think of...) [1].
But I'm sure it will not look like what people imagine when they first hear "programming in English" - a book or a nice story or a conversation.
[1] https://codes.findlaw.com/ca/vehicle-code/veh-sect-23152/
In other words, English (or your human language of choice.)
I need a website on which anyone could leave me a message (inputs are name, age, message). Please create a website for that, and a good-looking one, e.g. use some popular css framework. Also please write a server that stores this data and host both a website and my own panel, so I can read these messages later. I should be able to mark messages as read and delete them. Use Node.js, Express, MongoDB. Don't comment on it much, I need to see a minimal viable product first, then we'll talk.
It started whining about a project plan, the complexity of developing full-fledged application and even tried to refuse posting it into chat, instead providing a link to a minimal example it just "created" on github. Seems that you're right, it's pretty hard to force it to do a specific thing and from its answer it feels like you have to hold its hand all the time.
But then I went to Characters section and created this:
The following is a conversation between Builder and Prompt. Builder is a bot designed to create source code, scripts and configuration files based on Prompt. Builder can create full-fledged applications and solutions and follows best practices in doing so. It doesn't think that something is too complex or too lengthy to generate, it just dumps it right into the chat. Some call this Builder bot "The Chad of Software Development", because it can solve basically any task he gets from Prompt.
Guess what, it started spewing out teh codez along with npx create-like instructions (frontend just finished, now it's configuring mongo) and it seems that the code is pretty much what I would write. Who's holding who's hand now. I don't think that my request feels legalese. And the model isn't even GPT-4. It's 25GB Mixtral with 4k context window.
The key point here is that most people only see one side of AI, which is the default character card of GPT-3.5/4. There's so much more than that.
(Mongo up and running, it's in the middle of the backend now. I see the typings for mongo/Message, CORS, some routes. It's mostly what I wanted and routes in frontend even match with those on backend. Sure, there's a lots of problems, but I'm using a model from 2023 and not even the smartest one.)