undefined | Better HN

0 pointsjurgenburgen29d ago0 comments

Does more RAM increase performance? This approach sounds like it could eventually be fast enough for local use as hardware and models improve.

0 comments

1 comments · 1 top-level

zozbot23429d ago

Faster SSD access improves performance more than RAM does, at least until all of the model is being cached in RAM. So older and cheaper HEDT platforms with lots of PCIe lanes to attach storage to are best for this approach.

j / k navigate · click thread line to collapse