undefined | Better HN

0 pointskristianp5h ago0 comments

You're only going to get an incremental improvement with an M5 Pro mini compared to an M4 Pro mini. Memory bandwidth goes from 273GB/s to 307GB/s, about 12.5% improvement for LLMs.

0 comments

2 comments · 2 top-level

freehorse3h ago

M5's have the neural accelarator that boosts prefill speed a lot. But token generation itself will not change that much, that's true.

iagooar5h ago

I thought they might ship an M5 Max version, but you are probably right.

j / k navigate · click thread line to collapse