Skip to content
Better HN
Top
Best
Ask
Show
New
Jobs
Search
⌘K
0 points
JimmyRuska
3y ago
0 comments
Save
Share
Supposedly double the model size so 14gb. RTX 4090 might be able to handle it. You can use lambdalabs to rent a server gpu for one of the larger models.
0 comments
1 comments · 1 top-level
top
newest
oldest
TaylorAlexander
3y ago
I don't know if it matters but the 7B parameter checkpoint is 13.5GB in size. Someone with 24GB VRAM struggled to run it:
https://github.com/facebookresearch/llama/issues/55
j
/
k
navigate · click thread line to collapse