undefined | Better HN

0 pointscriley22y ago0 comments

The idea that any for-profit company can self-govern without external accountability is also magical thinking

A "Responsible AI Team" at a for-profit was always marketing (sleight of hand) to manipulate users.

Just see OpenAI today: safety vs profit, who wins?

0 comments

> Just see OpenAI today: safety vs profit, who wins?

Safety pretty clearly won the board fight. OpenAI started the year with 9 board members, and end it with 4, 4 of the 5 who left being interested in commercialization. Half of the current board members are also on the board of GovAI, dedicated to AI safety.

Don't forget that many people would consider "responsible AI" to mean "no AI until X-risk is zero", and that any non-safety research at all is irresponsible. Particularly if any of it is made public.

criley2OP2y ago

Rumor already has it that the "safety" board members are all resigning to bring Altman and the profit team back. When the dust settles, does profit ever lose to safety?

ethbr12y ago

Self-government can be a useful function in large companies, because what the company/C-suite wants and what an individual product team want may differ.

F.ex. a product team incentivized to hit a KPI, so release a product that creates a legal liability

Leadership may not have supported that trade-off, but they were busy with 10,000 other strategic decisions and not technical.

Who then pushes back on the product team? Legal. Or what will probably become the new legal for AI, a responsible AI team.

barney542y ago

Customers. Customers are the external accountability.

pixl972y ago

Yea, this works great on slow burn problems. "Oh, we've been selling you cancerous particles for the last 5 years, and in another 5 years your ass is totally going to fall off. Oh by the way we are totally broke after shoving all of our money in foreign accounts"

tropical3332y ago

Iff the customers have the requisite knowledge of what "responsible AI" should look like within a given domain. Sometimes you may have customers whose analytical skills are so basic there's no way they're thinking about bias, which would push the onus back onto the creator of the AI product to complete any ethical evaluations themselves (or try and train customers?)

criley2OP2y ago

Almost every disaster in corporate history that ended the lives of customers was not prevented by customer external accountability

https://arstechnica.com/health/2023/11/ai-with-90-error-rate...

Really glad to see that customer external accountability kept these old folks getting the care they needed instead of dying (please read with extremely strong sarcasm)

j / k navigate · click thread line to collapse

0 comments

tyrfing2y ago

> Just see OpenAI today: safety vs profit, who wins?

Don't forget that many people would consider "responsible AI" to mean "no AI until X-risk is zero", and that any non-safety research at all is irresponsible. Particularly if any of it is made public.

criley2OP2y ago

Rumor already has it that the "safety" board members are all resigning to bring Altman and the profit team back. When the dust settles, does profit ever lose to safety?

ethbr12y ago

Self-government can be a useful function in large companies, because what the company/C-suite wants and what an individual product team want may differ.

F.ex. a product team incentivized to hit a KPI, so release a product that creates a legal liability

Leadership may not have supported that trade-off, but they were busy with 10,000 other strategic decisions and not technical.

Who then pushes back on the product team? Legal. Or what will probably become the new legal for AI, a responsible AI team.

barney542y ago

Customers. Customers are the external accountability.

pixl972y ago

tropical3332y ago

criley2OP2y ago

Almost every disaster in corporate history that ended the lives of customers was not prevented by customer external accountability

https://arstechnica.com/health/2023/11/ai-with-90-error-rate...

Really glad to see that customer external accountability kept these old folks getting the care they needed instead of dying (please read with extremely strong sarcasm)

j / k navigate · click thread line to collapse