Hey man, it helps you think different. You just never knew your neurons needed accelerating.

I really hope someone got fired for this blunder

Which means what, exactly, to someone whose not a machine learning researcher?

Yes, they do. They're called Neural Engine, aka NPUs. They aren't being used for local LLMs on Macs because they are optimized for power efficiency running much smaller AI models.

Meanwhile, the GPU is powerful enough for LLMs but has been lacking matrix multiplication acceleration. This changes that.

Each GPU core, but yes, this was part of what they announced today - it’s now integral rather than separate.