undefined | Better HN

0 pointsWorkaccount29mo ago0 comments

People can ask whatever they want on LMarena, so a question like "List some good snacks to bring to work" might elicit a win for a old/tiny/deprecated model simply because it lists the snack the user liked more.

0 comments

AstroBen9mo ago

are you saying that's a bad way to judge a model? Not sure why we'd want ones that choose bad snacks

j / k navigate · click thread line to collapse

0 comments

AstroBen9mo ago

are you saying that's a bad way to judge a model? Not sure why we'd want ones that choose bad snacks

j / k navigate · click thread line to collapse

0 pointsWorkaccount29mo ago0 comments

People can ask whatever they want on LMarena, so a question like "List some good snacks to bring to work" might elicit a win for a old/tiny/deprecated model simply because it lists the snack the user liked more.