Skip to content
Better HN
Top
Best
Ask
Show
New
Jobs
Search
⌘K
0 points
Filligree
1y ago
0 comments
Save
Share
The GGUF quantisations do run on most recent hardware, albeit at increasingly concerning quality tradeoffs.
0 comments
1 comments · 1 top-level
top
newest
oldest
tripplyons
1y ago
I haven't noticed any quality degradation with the 8-bit GGUF for Flux Dev, but I'm sure the smaller quantizations perform worse.
j
/
k
navigate · click thread line to collapse
