undefined | Better HN

0 pointsianbicking2y ago0 comments

I thought I'd look it up to be sure, finding it in the official PDF [2]: "[Prohibited:] AI systems inferring emotions in workplaces or educational institutions, except for medical or safety reasons."

Elsewhere it specifically calls "emotion recognition" to be of "limited risk" (calling for transparency) and elsewhere kind of implies it to be "high risk" (as being part of the "annex"), though maybe it's just calling out use of emotion recognition in those high risk areas (e.g., credit scores).

But it doesn't seem to actually define "emotion recognition." (Though someone else says it involves biometric data, which seems in line with everything else in the regulation.)

All that said, it seems like under the law you could actually make emotion recognition systems, even for education, it's just that education institutions and workplaces couldn't use them. (Though that's a pretty big blocker for an educational tool!)

[1] https://www.europarl.europa.eu/topics/en/article/20230601STO...

0 comments

candiodari2y ago

So there's effectively a blanket exception for the organisations you really don't want to be doing this, ie. Police, the institution itself and government? (incidentally, government is your health insurance company in most of Europe)

I keep coming to the same problem with these regulations. I am much less afraid of Amazon/Google/... figuring out something about me and using it to sell me stuff than I am afraid of the police doing the same, and arresting me or otherwise having a huge negative impact on my life. Knowing the police, they'll probably not even do AI monitoring correctly, and of course, won't be responsible for the damage they cause.

Frankly, that Amazon and Google figure out stuff I might want to buy might actually be a positive. Maybe. Sometimes. If they become better at weeding out scams, that is.

ianbickingOP2y ago

While there's a hard block on using emotion recognition in workplaces and educational institutions, the other cases you list are listed under "High Risk" and so they are very much included in the regulation.

There are several exceptions for different kinds of law enforcement, things like eminent danger, or doing biometric filters when searching for someone that fits a description. How much you can squeeze in under those exceptions depends on how bold the police are. Probably a lot, but it's not written that way.

j / k navigate · click thread line to collapse