Just because you can't handle every situation that could occur when driving it doesn't mean you don't have the ability to drive. I can't parallel park, but I would still consider myself able to drive. I make mistakes driving where I'm not supposed to yet I'm still a driver.
But you're not stopping in the middle of the street for long periods in confusion because of a common situation. There's levels to this and the self driving cars are not yet at an acceptable level.
