undefined | Better HN

0 pointsstorus1d ago0 comments

So a minimum of 3x RTX Pro 6000 to run 1-bit at ~76% accuracy or MacStudio 512GB RAM to run 4-bit at ~97% accuracy.

0 comments

1 comments · 1 top-level

iaw23h ago

No. Unsloth has CPU offloading. It'll be slow but it'll work even with SSD offloading.

j / k navigate · click thread line to collapse