So, my reply in one sentence: a business should never charge less than it needs to meet its customers' expectations.
I don't think I've ever seen any hosted service brazenly advertise, "It only costs $4 a month and it's only down for a couple of days a year!" Instead, hosted services advertise their pricing, and then hide their uptime "guarantee" (in quotes because it's only a guarantee to the extent that there might be refunds involved if they don't meet it) somewhere in their fine print, or as a number that sounds impressive to people who don't know better, like, "99%!"
The problem with that is that your customers still expect your service to work. If your customers build a business of their own using your service -- and if you have enough customers, somebody is gonna try to do that -- then they can be seriously impacted if your service fails. At that point you have an adversarial relationship with your customer. As a business, you want to say, "but you're only paying $4 a month! What did you expect?", but as a customer, that's just about the worst possible response.
I think the race to the bottom in pricing is a really bad idea. GoDaddy's a really good example to use here. How many of their customers do you think couldn't afford an extra $1 a month, and at their scale, how much could they improve their service if they made an extra $1/month per customer? Conversely, how much damage does GoDaddy do to the hosting industry as a whole every time they piss off their millions of customers? I think you have to charge enough money to make your customer happy, and that includes a little extra to make sure your service continues to grow and improve and that you continue to be happy so that you'll continue to want to work on your business.
Once the business is up and running at some price point, and your infrastructure is, let's say, 75% complete, then start looking in to ways to reduce your price without compromising your service. Maybe if you find a thousand more customers, some network effects will kick in and you'll be able to charge everybody a little bit less. Great, go find those customers.
And, let's not ignore that the technology available to service providers right now is amazing. I first wanted to be an ISP in 1995. Back then, your startup costs were atrocious, the technology was unreliable, documentation was opaque (no such thing as howtoforge!), and you had to rely on industry fatcats that would shake with their right hand and shank you with their left.
Now there's Linode, Rackspace, Hurricane Electric, Slicehost, Heroku, Amazon, and a ton of others, all offering easy-to-use, low-cost, reliable services that you can build your business on. It's really amazing stuff. While individually they have sporadic issues, collectively they're rock-solid. So, unless you're offering a service that cracks hashes, I have trouble imagining that it would cost as much as $2,000 a month to provide a 100% uptime guarantee. If you just want to host a particular technology stack for customers, or provide SaaS, you should be able to engineer a really solid service for $50/month, tops.
Finally, I left room in my previous comment on this for businesses that are growing. I don't expect a business to have the perfect infrastructure in place the day that they launch. I do expect them to, at the very least, have solid backups in place and an idea of what to do if everything goes upside-down one day. Then, once they start getting customers, they should focus on improving their infrastructure. If a business is a year old and they have a few hours' downtime one day, I don't think to myself, "Pf, amateurs." But, if a business is two or three years old, and their customers' usernames and passwords just showed up on pastebin because they wrote their web app in PHP and didn't use PDO? Yeah, amateurs for sure.
As a thought experiment, imagine if GoDaddy took all the money that they sunk into Superbowl ads and pretty women and other stupid marketing, and instead put that money towards being the best damn domain registrar and hosting service on the internet. I bet you they could monopolize their market. There'd no longer be any reason at all for any of their customers to use any other service. There'd no longer be any reason for a potential new customer to not use their service.
So, want to own your market? Build an unbeatable service. (Or product.)
And you have to charge your customers enough money to do that.