Skip to content
Better HN
Top
Best
Ask
Show
New
Jobs
Search
⌘K
0 points
joaogui1
2y ago
0 comments
Save
Share
That looks interesting, do you know what paper talks about the connection between MDL, regret, and weight decay?
0 comments
2 comments · 1 top-level
top
newest
oldest
tbalsam
2y ago
· 1 in thread
I would start with Shannon's information theory and the Wikipedia page on L2/the MDL as a decent starting point.
For the first, there are a few good papers that simplify the concepts even further.
joaogui1
OP
2y ago
Sorry, I know what MDL and L2 regularization are, I would like the paper that connects them in the way you mentioned
j
/
k
navigate · click thread line to collapse