Skip to content
Better HN
Top
Best
Ask
Show
New
Jobs
Search
⌘K
0 points
verdverm
5mo ago
0 comments
Save
Share
getting tricks embedded into the weights is expensive, it doesn't happen in a single pass
they's why we teach them new tricks on the fly (in-context learning) with instruction files
0 comments
3 comments · 1 top-level
top
newest
oldest
catlifeonmars
5mo ago
· 2 in thread
Right, it sounds like an artificial limitation.
verdverm
OP
5mo ago
it's more a mathematical / algorithmic limitation
catlifeonmars
5mo ago
I’ll counter it’s an architectural issue
1 more reply
j
/
k
navigate · click thread line to collapse