The USAF created a simulation to test how an AI controlled F-16 would behave in various combat situations. The AI was incentivized to complete its mission. Recognizing that the human in loop was the weakest link the real AI in the simulation killed its simulated human handler.
When instructed to stop killing its human in loop handler, it destroyed the control tower the human used to interact with it.
The US military is playing with fire creating AI that will carry out the mission at all costs. This scenario is literally the plot of EVERY sci-fi warning about misused AI.
Anyone read/see 2001?
You’d think we’d take the warnings provided by our own worst nightmares more seriously.