undefined | Better HN

0 pointsgiancarlostoro1d ago0 comments

Quite the opposite, you want something below your max VRAM and you use up to your max VRAM for the context window, so it can run longer.

0 comments

1 comments · 1 top-level

Sorry, I meant a 24GB MacBook Pro model, to run a 16GB LLM :)

My use of the term model here is confusing

j / k navigate · click thread line to collapse