Ever drive off and leave your trunk lid open? Forget a kid at the mall? Not call your Mom on Mothers' Day? Then you understand how easy it is for human error to occur.
A doctor named Atul Gawande wrote a book named The Checklist Manifesto https://www.amazon.com/Checklist-Manifesto-How-Things-Right/...
Early in his career he did some research that showed that a simple pre-surgery checklist could reduce serious complications by more than a third. https://www.pbs.org/newshour/health/dr-atul-gawande-surgical...
If leaving a hatch open causes one year of repairs and it contains a nuclear reactor maybe some automated sensors or checklists would be quite sensible.
Really all human error that has happened before is predictable. My rule for myself is to assume any mistake I've ever made, or imagined making, is possible.
Understanding and preventing human error is a basic part of design. Especially for things that cost $3B.
https://abcnews.go.com/amp/Politics/navy-warships-narrowly-a...
https://amp.cnn.com/cnn/2017/11/01/politics/navy-fitzgerald-...