I think people are worried no one really understands how AI picks the target.

Reminds me of that story from probably 5-7y ago. Someone wanted to use AI to classify photos of tanks as soviet vs US. So he went to a US tank museum and took lots of pictures of the tanks under every angle. Did the same in a soviet tank museum. The resulting model worked great on that training dataset. Then he tried on photos outside of the training dataset. Turned out that it was cloudy the day he visited the US museum and sunny for the soviet museum, and the model used the color of the sky to classify.

What if the AI was trained on data collected and assembled by someone with "tribal bloodlust".

What happens when you put a computer in front of the judges at the ICC?

I'm having to take a few deep breaths before responding to some of these comments. The difference is Accountability. A computer can't be held accountable and a person can. Full stop. It makes all the difference.

Perhaps it performs sentiment analysis of your social media posts.

when a computer program designed by a human "makes" the decision, humans can claim that it was "a funny mistake", it was not their fault and pretend to be very sad for it.

Having a human to make those decisions is better because this human can be judged if commits war crimes or genocide or violates international war laws.

A computer can't be jailed and this is the real power of designing this system. To hide the criminals on a black box so nobody can be made responsible