The bar is much higher than that. You are supposed to protect others, not just yourself, and including people who are at fault.

If a pedestrian is jaywalking and you provably have plenty of time and ability to avoid them, but you strike and kill them, you are definitely guilty of something like manslaughter. Although people somethings believe otherwise, the law (and morality) do not have the property that initial minor transgressions by one party absolve the other party of all fault in a resulting interaction.