LLMs: Solvers vs. Judges (opens in new tab)

(bensantora.com)

2 pointstruelinux119d ago1 comments

1 comments

I gave several LLMs a logic puzzle with an embedded contradiction. Some flagged it. Some quietly bent the rules to produce an answer anyway.

Knowing which type of model you're using (a helpful solver or a strict judge) really matters.

j / k navigate · click thread line to collapse

(bensantora.com)

2 pointstruelinux119d ago1 comments

I gave several LLMs a logic puzzle with an embedded contradiction. Some flagged it. Some quietly bent the rules to produce an answer anyway.

Knowing which type of model you're using (a helpful solver or a strict judge) really matters.

j / k navigate · click thread line to collapse