Skip to content
Better HN
Top
Best
Ask
Show
New
Jobs
Search
⌘K
0 points
fuddle
6mo ago
0 comments
Save
Share
I don't think SWE Verified is an ideal benchmark, as the solutions are in the training dataset.
0 comments
1 comments · 1 top-level
top
newest
oldest
joshuahedlund
6mo ago
I would love for SWE Verified to put out a set of fresh but comparable problems and see how the top performing models do, to test against overfitting.
j
/
k
navigate · click thread line to collapse
