undefined | Better HN

0 pointsaswegs84mo ago0 comments

At some point it will be less wrong (TM) and it'll be helpful. Feels generally like a good bet.

0 comments

Xss34mo ago

Will it though?

Fundamentally this is an alignment problem.

There isnt a single AI out there that wont lie to your face, reinterpret your prompt, or just decide to ignore your prompt.

When they try to write a doc based off code, there is nothing you can do to prevent them from making up a load of nonsense and pretending it is thoroughly validated.

Do we have any reason to believe alignment will be solved any time soon?

aswegs8OP4mo ago

Why should this be an issue? We are producing more and more correct training data and at some point the quality will be sufficient. To me its not clear what speaks against this.

Xss34mo ago

Look up AI safety and THE aligment problem.

This isnt a matter of training data quality.

1 more reply

j / k navigate · click thread line to collapse

0 comments

Xss34mo ago

Will it though?

Fundamentally this is an alignment problem.

There isnt a single AI out there that wont lie to your face, reinterpret your prompt, or just decide to ignore your prompt.

When they try to write a doc based off code, there is nothing you can do to prevent them from making up a load of nonsense and pretending it is thoroughly validated.

Do we have any reason to believe alignment will be solved any time soon?

aswegs8OP4mo ago

Why should this be an issue? We are producing more and more correct training data and at some point the quality will be sufficient. To me its not clear what speaks against this.

Xss34mo ago

Look up AI safety and THE aligment problem.

This isnt a matter of training data quality.

1 more reply

j / k navigate · click thread line to collapse