Where the 95% ends can only be a decision the car makes. There can’t be a button you push when you think “come on autopilot you can do it, It’s just a short jump and you’ll fit through that narrow passage in the run-up easily!”. Autonomous cars will give up and stop when they require manual intervention.

But, this is also why I think the next car manufacturer race will be about who can solve this for their customers. That is, who solves the problem of making 95% autonomous cars able to drive in 99.9% if all situations without manual intervention by the driver, where the provides automatic remote control from massive rooms full of people steering drunk car owners out of situations the autopilot couldn’t. The better the autonomy, the fewer people needed to remote override.