"if a plastic bag or piece of cardboard rolls across the highway a human driver knows it's safe to run over without stopping." Well, usually. But frequently they don't see it at all, or freeze and hit it whatever it is, or swerve three lanes over, or jam on the brakes in front of you.
It only has to be better than humans, not perfect.