1
Now that local LLMs are gaining traction, I’m wondering what the equivalent stack looks like today.
Models, Runtime, hardware and other tools.
That could rival the Claudes, ChatGPTs or Geminis, etc
Thanks
In the future everyone will have a personal cloud, where they will easily install cloud programs.
Everyone will have a private server that can serve billions of requests/per second.
All those super-advanced technology from big tech will trickle down into small compact servers.