Imagine I am a cyclist and I don't signal but I swiftly swerve to the right. Unless the self-driving car is already at a slow speed, it would impose an undue risk. Or, it is hard to expect that humans will rigorously adhere to this traffic discipline.
This is why these cars will drive slow for the foreseeable future and will frustrate a good chunk of the drivers.
Unless it gets dedicated lanes, the way bicycles do.