Skip to content
Better HN
Top
New
Best
Ask
Show
Jobs
Search
⌘K
undefined | Better HN
0 points
verdverm
2mo ago
0 comments
Share
getting tricks embedded into the weights is expensive, it doesn't happen in a single pass
they's why we teach them new tricks on the fly (in-context learning) with instruction files
0 comments
default
newest
oldest
catlifeonmars
2mo ago
Right, it sounds like an artificial limitation.
verdverm
OP
2mo ago
it's more a mathematical / algorithmic limitation
catlifeonmars
2mo ago
I’ll counter it’s an architectural issue
1 more reply
j
/
k
navigate · click thread line to collapse