Google says 3e-4 is the best lr for Adam (misinterpreted Karpathy's joke) (opens in new tab)

(google.com)

1 pointsvukadinovic4y ago1 comments

1 comments

1 comments · 1 top-level

Google misinterpreted Karpathy's (joke) tweet, and by searching " what is the best learning rate for adam optimizer " says that " 3e-4 is the best hands down ".

j / k navigate · click thread line to collapse