undefined | Better HN

0 pointsmeiraleal1y ago0 comments

Yes they will. They are already, if you run local models, that are only getting better. There are 7-11B models that are as good as ChatGPT 3.5

0 comments

3 comments · 2 top-level

hoerzu1y ago· 1 in thread

Ok, but running a 11B model gets things 60% of the time right and consumes maximum of electricity of your machine. Not sure if that makes you product the best. Further video generation is very compute intensive. I guess price will decrease over time but the technical advance will allways be for the smarter model

meiralealOP1y ago

> and consumes maximum of electricity of your machine

OpenAI isn't a eletricity company so the token prize is still zero for what is worth for VCs.

> but the technical advance will allways be for the smarter model

Not true. Currently, the small models are advancing much faster with daily new releases

chatmasta1y ago

Token costs are not zero when you’re running local models, because you paid for the hardware, and you can’t scale inference indefinitely without paying for more hardware.

j / k navigate · click thread line to collapse