It reminded me of my very first experiences with ChatGPT a bit. Clearly less capable than something like Opus 4.6, but I made me excited about the possibilities.
I know that fairly capable models can be run by mere mortals who have a fancy GPU.
My real question is, will some combination of hardware and software optimizations get us anywhere close to "state of the art" models running on truly basic hardware?
With all the ridiculous capex being spent on datacenters etc, what if something akin to Moore's Law, or other algorithmic breakthroughs, will get us super capable LLMs that can run on the average machine?
