undefined | Better HN

0 pointsnomel23d ago0 comments

Maybe, every night, you send the AI off to "sleep" where it uses those in cache "memories" to influence the long term weights [1].

0 comments

1 comments · 1 top-level

Context self-distillation does exist, but as is, it's used mostly in training rather than as a part of a continuous learning mechanism.

j / k navigate · click thread line to collapse