That is a good point about EC2 being a black box. When something really slows down (SimpleDB queries, network access, etc.) it takes effort to track down the problem(s).
I think that AWS is a good resource for scaling up non-realtime calculations like map reduce, but may not be a great choice for 24x7 hosting.