undefined | Better HN

0 pointswhynotminot1y ago0 comments

“Objective benchmarks are useless, let’s argue about which one works better for me personally.”

0 comments

Yes. My benchmarks and their benchmarks means AGI. Their benchmarks only means over-fitted.

Ok so what if we get different results for our own personal benchmarks/use cases.

(See why objective benchmarks exist?)

Yes, "objective" benchmarks can be gamed, real-life tasks cannot.

j / k navigate · click thread line to collapse

Yes. My benchmarks and their benchmarks means AGI. Their benchmarks only means over-fitted.

Ok so what if we get different results for our own personal benchmarks/use cases.

(See why objective benchmarks exist?)

Yes, "objective" benchmarks can be gamed, real-life tasks cannot.

j / k navigate · click thread line to collapse