Self-driving cars don't promise to save time. It's still driving. Their promise -- their only real promise -- is to save lives. And I think saving tens of thousands of American lives every year is a worthwhile goal. Worldwide, more than 1 million people die in car crashes every year. Humans have proven that they can't drive cars well, but we have put up with it because it is convenient.
I know some people will say that they could work on their way to work, but I can't do work in a car. Staring at a laptop in a car gives me motion sickness, along with a lot of other people. And, of course, this would only apply to people who do computer work in the first place.
As someone who has been in serious car crashes and lost friends to them, I for one am all for self-driving cars. It's going to be a revolution, but we shouldn't be testing them on public roads if they are this bad.