undefined | Better HN

0 pointsgchamonlive1mo ago0 comments

What about the analysis evidences?

0 comments

Retr0id1mo ago

You mean the Claude output? The same claude that has "regressed to the point it cannot be trusted"?

gchamonliveOP1mo ago

What you saying the OP fabricated/hallucinated the evidence?

Retr0id1mo ago

I'm just saying it's epistemically unrigorous to the point of being equivalent to anecdata.

gchamonliveOP1mo ago

How should one conduct such a rigourously reproducible experiment when LLMs by nature aren't deterministic and when you don't have access to the model you are comparing to from months ago?

1 more reply

j / k navigate · click thread line to collapse

0 comments

Retr0id1mo ago

You mean the Claude output? The same claude that has "regressed to the point it cannot be trusted"?

gchamonliveOP1mo ago

What you saying the OP fabricated/hallucinated the evidence?

Retr0id1mo ago

I'm just saying it's epistemically unrigorous to the point of being equivalent to anecdata.

gchamonliveOP1mo ago

How should one conduct such a rigourously reproducible experiment when LLMs by nature aren't deterministic and when you don't have access to the model you are comparing to from months ago?

1 more reply

j / k navigate · click thread line to collapse