undefined | Better HN

0 pointsranger_danger2mo ago0 comments

A 10GB 3080 still beats even an M2 Ultra with 192GB... memory bandwidth is not the only factor.

0 comments

If the model is small enough to fit in to 10GB of VRAM the GPU can win.

But the bigger models are more useful, so that’s what people fixate on.

j / k navigate · click thread line to collapse

If the model is small enough to fit in to 10GB of VRAM the GPU can win.

But the bigger models are more useful, so that’s what people fixate on.

j / k navigate · click thread line to collapse