That may be grounds for a mistrial. Decisions about crimes are not judged by the "maximum likelihood".
> what specific analysis would convince you that this algorithm is predictive and non-biased
What is it going to take to convince you that the choice of model and which data to use as input is just as important as the analysis itself?
> race_factor
Depending on the situation, using race or other protected classes is illegal. One of the reasons we have a right to face our accusers is to provide an opportunity to challenge those accusations. Racial (or any other protected class) discrimination doesn't become legal when it is hidden behind an equation or algorithm. If the government wants to keep the method secret, then anything derived from those methods should be excluded.
> human biases
...are off topic. An algorithm needs to justify it's own existence.
> it's not very big
So you're fine with racial bias, as long as it only affects what you consider a "small" number of people.
> or perhaps black defends actually are more likely to commit crimes
/sigh/
