A company like Cerebras (founded in 2015) proves that this is true.
The moat is not in computer architecture. I'd say the real moat is in semiconductor fabrication.
Oh my.
Please people, try to think back to your engineering classes. Remember the project where you worked with a group to design a processor? I do. Worst semester of my life. (Screw whoever even came up with that damn real analysis math class.) And here's the kicker, I know I'll be dating myself here, but all I had to do for my part was tape it out. Still sucked.
Not sure I'd call the necessary processor design work here "relatively easy"? Even for highly experienced, extremely bright people, this is not "relatively easy".
Far more easy to make the software a commodity. Believe me.
I mean this is like saying that a class for building compilers sucked. Still, companies make compilers, and they aren't all >$1B companies. In fact, hobbyists make compilers.
That you are comparing designing and writing a compiler with designing and manufacturing a neural processor is only testimony to the futility of my attempt to impress on everyone the difference. So I'll take my leave.
You have a good day sir or ma'am.
Semiconductor fabrication is a high risk business.
Nvidia invested heavily in CUDA and out-competed AMD (and Intel). They are working hard to keep their edge in developer mindshare, while chasing hardware profits at the same time.
Yes. I'd never touched any of that stuff and then one day decided to give it a shot. Some how-to told me how to run something on Linux which had a choice of a few different LLMs. I picked one of the small ones (under 10B) and had it running on my AMD APU inside of 15 minutes. The weights were IIRC downloaded from huggingface. The wrapper was not. Anyway, what's the problem?
BTW that convinced me that small LLMs are basically worthless. IMA need to go bigger next time. BTW my "old" 5700G has 64GB of RAM, next build I'll go at least double that.
No, but seeing how easily they run on Apple hardware, I don't understand your point, to be honest.
In the longer run, anything that is very capital intensive, affects entire industries, and can be improved with large amounts of simulation will not be a moat for long. That's because you can increasingly use AI to explore the design space.
Compute not a commodity yet but may be in a few years. Semiconductor fab will take longer, but I wouldn't be surprised to see parts of the fabrication process democratized in a few years.
Physical commodities like copper or oil can't be improved with simulation so they don't fall under this idea.
It's like trying to take on UPS with some new, not quite drop-in logistics network. Theoretically its just a bunch of empty tubs shuffling around, but not so easy in practice. You have to be multiples better than the incumbent to be in contention. Keep in mind for the startups we don't really know who is setting money on fire running models in unprofitable configurations for revenue.
