Not everyone has to know about, understand, or use open source solutions for it to open the field.
You need to pay energy bill, do the update/upgrade and you need to build a LLM rig.
Nvidias Digits Project could be very interesting, but this box will cost 3k.
We are a lot closer to running it at home than i assumed we would but plenty of people prefer SaaS over doing stuff themselves.
This is just a weird dichotomy you're introducing. Open source will introduce price pressure as any competition will - that doesn't mean you won't have a monopoly.
Idk what you mean by saying this doesn't preclude a monopoly - having your pricing power eroded by competition is kinda one of the key features of what a monopolistic market isn't
Feels like I won't be paying for anything that isn't real-time. And that any time delay I can introduce in my process will come with massive savings. Picture hiding the loading of loot info behind a treasure chest opening animation in a game, except that time difference means you can pull all the work in-house.
Openrouter.ai seems like a step in the right direction but I'd want to do all their calculations myself as well as factor in local/existing gear in a way they don't.
Right now the average person has to go through a vendor with a web app, there's not a lot of room for the public to explore.
Things could change in a hurry.
I don't think we expect a company to exist solely making a proprietary web server anymore and be a behemoth of 300B. OpenAi might end up at the same model as Nginx or Docker if they don't pivot or find a different model.
