I've been tinkering with some models and I'm currently progressing through a few personal projects with Gemma in Antigravity. I'm not an engineer, but I have a very good technical understanding, I'm competent enough to build something by myself.
I've been going though my personal projects feature by feature. So far I've had good success, and as I'm doing it step by step I'm checking what's being created. 90% of the time it's correct and when bugs occur I can work through them and identify the issue, and then explain it to the agent to fix.
I don't think you could ever just set an agent off to create something by itself, unless you have a very detailed comprehensive technical document for it to follow along outlining the big picture and all details within - even then I think the context window wouldn't be enough and it may start tripping up.
The projects I've tried to date:
- A love2D game (success)
- Buildroot linux for an SBC with above game embedded (success, but with several issues related to the framebuffer, other drivers etc. Fixing this took about an hour of my time and burnt through all of the available thinking model tokens in two sessions.
- A few offline web projects (ongoing, success when going feature by feature)
- A micro controller project (ongoing)