This needs empirical support. All of us are human, and are susceptible to false senses of security. Most of us are not good at assessing real-world risks and probabilities. If the autopilot software is good enough to drive the car successfully for months on end, drivers will start to trust it. It will be very hard to stay vigilant and aware, with eyes on the road at all times and an alertness level on par with manual driving.

In other words, an otherwise “good” driver can easily be lulled into complacency by a system that’s really good, but not perfect. It’s an uncanny valley that is worth discussing.