Skip to content
Better HN
Top
Best
Ask
Show
New
Jobs
Search
⌘K
Unsloth creators fix universal error with gradient accumulation
(opens in new tab)
(unsloth.ai)
4 points
ZQ-Dev8
1y ago
2 comments
Save
Share
2 comments
2 comments · 2 top-level
top
newest
oldest
gnabgib
1y ago
Article title:
Bugs in LLM Training - Gradient Accumulation Fix
ZQ-Dev8
OP
1y ago
seems like something pytorch maintainers would want to know about and fix asap...
j
/
k
navigate · click thread line to collapse
