Skip to content
Better HN
Top
Best
Ask
Show
New
Jobs
Search
⌘K
0 points
oompydoompy74
2mo ago
0 comments
Save
Share
Remaining dependent on proprietary frontier models that you can only access via an API makes no sense whatsoever. My hope is that the future is open weight models running on local hardware.
0 comments
1 comments · 1 top-level
top
newest
oldest
naasking
2mo ago
Eventually, yes. ParoQuant is hopefully the future here, 4-bit weights with no real degradation from FP16:
https://github.com/z-lab/paroquant
j
/
k
navigate · click thread line to collapse