undefined | Better HN

0 pointsfluoridation5mo ago0 comments

I think the real killer feature would be that they stop making basic mistakes, and that they gain some introspection. It's not a problem if they're wrong 30% of the time if they're able to gauge their own confidence like a human would. Then you can know to disregard the answer, or check it more thoroughly.

0 comments

xpe5mo ago

> It's not a problem if they're wrong 30% of the time if they're able to gauge their own confidence like a human would.

This is a case where I would not use human performance as the standard to beat. Training people to be both intellectually honest and statistically calibrated is really hard.

fluoridationOP5mo ago

Perhaps, but an AI that can only answer like a precocious child who's spent years reading encyclopedias but has not learned to detect when it's thinking poorly or not remembering clearly is much less useful.

j / k navigate · click thread line to collapse

0 comments

xpe5mo ago

> It's not a problem if they're wrong 30% of the time if they're able to gauge their own confidence like a human would.

This is a case where I would not use human performance as the standard to beat. Training people to be both intellectually honest and statistically calibrated is really hard.

fluoridationOP5mo ago

j / k navigate · click thread line to collapse