undefined | Better HN

0 pointscbg024d ago0 comments

That performance monitor is super easy to game if you cache responses to all the SWE bench questions.

0 comments

You dramatically overestimate how much time engineers at hypergrowth startups have on their hands

There's a direct business incentive to game/cheat benchmarks, it wouldn't even be difficult to do, and besides, they have workforce-replacing AI to do it for them.

1 more reply

cbg0OP24d ago

Caching some data is time consuming? They can just ask Claude to do it.

j / k navigate · click thread line to collapse