We could have shut down our coal plants first and our nuclear plants later and would have much reduced total emissions. But we chose to do it the other way round.
Humans are terrible at evaluating rare but expensive failure modes. Nuclear power is far safer than just coal mining operations, even taking into account accidents.