undefined | Better HN

0 pointsThe_rationalist5y ago0 comments

0 comments

That's cool, but Mish is an activation function while SGD and AdamW are optimizers. Apples and oranges.

j / k navigate · click thread line to collapse

0 pointsThe_rationalist5y ago0 comments

That's cool, but Mish is an activation function while SGD and AdamW are optimizers. Apples and oranges.

j / k navigate · click thread line to collapse