undefined | Better HN

0 pointsYiin1mo ago0 comments

I mean it's not hard to understand that if good model can run on consumer hardware, even better models can run in data centers

0 comments

francasso1mo ago

If we get to the point where a local model can reliably do the coding for a good majority of cases, then the economic landscape changes significantly. And we are not that far from having big open weight models that can do that, which is a first step

neonstatic1mo ago

Larger, yes, absolutely. Better? Right now it seems that bigger is better, but if we are thinking about long term future, it's not obvious that there isn't a point of diminishing returns with regards to size. I can also imagine a breakthrough, where models become much smaller, with the same or better capabilities as the current, very large ones.

hodgehog111mo ago

You are always going to get the same scaling laws in model size regardless of what else you do, so the same degree of improvement seen now relative to the smaller models will be achievable in the future. Yes, small models may be on par with previous generation large models, but the same is true for processors and you don't see supercomputers going away. It's the same principle.

j / k navigate · click thread line to collapse

0 comments

francasso1mo ago

neonstatic1mo ago

hodgehog111mo ago

j / k navigate · click thread line to collapse