undefined | Better HN

0 pointsyummyfajitas9y ago0 comments

No, bogus correlations and inaccurate conclusions are explicitly NOT the computer science problem being worked on here. You are trying to frame the problem as algorithms wrongly classifying people. That's just a standard statistics problem (called "overfitting") and has nothing to do with fairness.

The problem being worked on here is "what if Armenians shouldn't get car loans because they don't pay them back as much as other groups?" I.e., algorithms rightly classifying people leads to results that we believe are "unfair".

This research is illustrating that you can't simultaneously have accuracy and fairness. You need to explicitly decide how much accuracy you are willing to give up to get fairness. I.e. it's computing the tradeoffs needed to evaluate the ethical question: how many Armenian deadbeats should you extend credit to in order to be "fair"?

Go play with the simulation to see. The various fairness criteria all achieve lower than maximal profits.

0 comments

qb459y ago

I think what the research itself (as opposed to politics surrounding it) was about is summed up in the last paragraph:

A key result in the paper by Hardt, Price, and Srebro shows that—given essentially any scoring system—it's possible to efficiently find thresholds that meet any of these criteria.

The crucial thing is that this "credit score" doesn't actually predict defaults quite well, because blues who are 50% likely to default have higher score than oranges who are 50% likely to default. If you base decision on a simple credit score cutoff, the blue defaulters will screw you up because of their higher score. You can defend from this by tweaking cutoffs per-group to achieve profit maximization or various "fairness" goals. In a sense, it's an attempt at producing non-garbage out from garbage in.

And of course whether real-world implementations of this idea are "good" or "bad" is another can of worms altogether and varies case by case. They probably could have came up with some better examples than credit scores and labeling people by colors.

yummyfajitasOP9y ago

Let me repeat what I said: Go play with the simulation to see. The various fairness criteria all achieve lower than maximal profits.

The best predictor is one which is explicitly discriminatory based on race: it takes both FICO score and race into account. There are worse predictors which also discriminate explicitly based on race, but in some "fair" way.

Finally, the worst predictor throws away directly relevant racial information.

This is not about garbage input data - that's not the problem being addressed here at all. The input data is perfectly fine. The problem is just that the input data says "race discrimination is the best way to make money".

qb459y ago

I think you are being deceived by your real-world presumptions about the fictional example somewhat unfortunately and misleadingly engineered by Google. From your previous post:

> The problem being worked on here is "what if Armenians shouldn't get car loans because they don't pay them back as much as other groups?" I.e., algorithms rightly classifying people leads to results that we believe are "unfair".

No. If you stop playing with simulation and look at the input data, Armenians don't pay back less. They pay exactly as much as Iranians except that Iranians consistently have higher FICO scores because Iran infiltrated FICO with their suckxnet(TM) worm which replaces R binaries with hacked versions. Or something like that :)

The general abstract idea is: you have some input "score" which is know to inaccurately predict the outcome, use the input score and measurements of its biases to produce more accurate prediction than naive threshold classifier would.

And yes, the other guys talking about women's healthcare costing more or men causing more traffic accidents got it wrong too. I somewhat arbitrarily responded to you because you said something about "the real computer science problem being worked on here" and then continued to talk about other things like everybody else.

1 more reply

tptacek9y ago

"We proposed a fairness measure that accomplishes two important desiderata. First, it remedies the main conceptual shortcomings of demographic parity as a fairness notion. Second, it is fully aligned with the central goal of supervised machine learning, that is, to build higher accuracy classifiers."

Your dispute may be with the authors.

yummyfajitasOP9y ago

No, you are misunderstanding things. They aren't improving accuracy, reducing overfitting, or improving generalizability. If you think I'm wrong, feel free to cite the part of the paper where they claim to build a better FICO score (to go with their example).

argonaut9y ago

You're misreading the meaning of "fully aligned." If you read the 3 paragraphs preceding that sentence, the authors are referring to organization incentives being "aligned."

j / k navigate · click thread line to collapse

0 pointsyummyfajitas9y ago0 comments

Go play with the simulation to see. The various fairness criteria all achieve lower than maximal profits.

0 comments

qb459y ago

I think what the research itself (as opposed to politics surrounding it) was about is summed up in the last paragraph:

A key result in the paper by Hardt, Price, and Srebro shows that—given essentially any scoring system—it's possible to efficiently find thresholds that meet any of these criteria.

yummyfajitasOP9y ago

Let me repeat what I said: Go play with the simulation to see. The various fairness criteria all achieve lower than maximal profits.

Finally, the worst predictor throws away directly relevant racial information.

qb459y ago

I think you are being deceived by your real-world presumptions about the fictional example somewhat unfortunately and misleadingly engineered by Google. From your previous post:

1 more reply

tptacek9y ago

Your dispute may be with the authors.

yummyfajitasOP9y ago

argonaut9y ago

You're misreading the meaning of "fully aligned." If you read the 3 paragraphs preceding that sentence, the authors are referring to organization incentives being "aligned."

j / k navigate · click thread line to collapse