Yes, confidence in a currency is very important to its survival. The crazy volatility, the inability to withdraw sometimes, the competitors, the uncertainty everywhere. Bitcoin is not helping itself.
It seems unlikely to me that, after surviving all the things you mention, Bitcoin's downfall would be the result of some temporary downtime from a couple of exchanges. I guess you could argue it's the proverbial final straw on the camel's back, though.