undefined | Better HN

0 pointsdevoutsalsa1y ago0 comments

When the source code for these LLMs gets leaked, I expect to see:

    def letter_count(string, letter):
        if string == “strawberry” and letter == “r”:
            return 3

        …

0 comments

In of their release videos for the o1 -preview model they _admitted_ that it's hardcoded in.

Honestly I'm concerned how hacked up o3 is to secure a high benchmark score.

j / k navigate · click thread line to collapse

0 pointsdevoutsalsa1y ago0 comments

When the source code for these LLMs gets leaked, I expect to see:

    def letter_count(string, letter):
        if string == “strawberry” and letter == “r”:
            return 3

        …

In of their release videos for the o1 -preview model they _admitted_ that it's hardcoded in.

Honestly I'm concerned how hacked up o3 is to secure a high benchmark score.

j / k navigate · click thread line to collapse