undefined | Better HN

0 pointsfc417fc8021y ago0 comments

> only if you do a gradient step with data sampled from the exact same weights is it an online step.

Bit pedantic, but amusing thought; wouldn't that imply that asynchronous actor critic is an offline training methodology?

0 comments

Yes, pedantically, it is! But as I said, everything's on a spectrum. Online-ish data can still work just fine.

j / k navigate · click thread line to collapse

0 pointsfc417fc8021y ago0 comments

> only if you do a gradient step with data sampled from the exact same weights is it an online step.

Bit pedantic, but amusing thought; wouldn't that imply that asynchronous actor critic is an offline training methodology?

Yes, pedantically, it is! But as I said, everything's on a spectrum. Online-ish data can still work just fine.

j / k navigate · click thread line to collapse