undefined | Better HN

0 pointsknowriju5mo ago0 comments

ARC-AGI has a hidden private test suite, right ? No model will have access to that set.

0 comments

I doubt they have offline access to the model, i.e. the prompts are sent to the model provider.

Even if the prompts are technically leaked to the provider, how would they be identified as something worth optimizing for out of the millions of other prompts received?

j / k navigate · click thread line to collapse

0 comments

variadix5mo ago

I doubt they have offline access to the model, i.e. the prompts are sent to the model provider.

xlbuttplug25mo ago

Even if the prompts are technically leaked to the provider, how would they be identified as something worth optimizing for out of the millions of other prompts received?

j / k navigate · click thread line to collapse