"Incredibly simple to use" compared to what?
How hard is it to get the same functionality out of a set of rented servers? Or a fully hosted level-7 IaS? Or a fast starting VPS park?
The allegedly benefit of AWS is that you just focus on development, and let Amazon handle all the OPS noise. Well, minimizing costs is a lot of OPS noise.