And if you can remote in, I'm worried about hacks. Imagine the chaos if a terrorist group got in and turned the wheel of an entire fleet in a random direction. It seems to me anything can get hacked/any individual can be pressed, and it's alsways just a matter of if it's worth the trouble. Seems a hack like this is would be worth some, to some groups. Also: they only need to succeed Once. The rest of us need to have perfect security among all fleets of all corporations and brands for all time.
If you can call for a driverless Taxii then there is some level of remote access. So, it's going to be a concern in either case. However, you can set the car to dial out when it's confused rather than waiting for remote connections which reduces the attack surface.