Or take the middle road and just get rent the hardware (aka, dedicated hosting). You pay more than colo but still way less than cloud, get the same level of hardware support as a cloud provider but the same performance as colo.
Yep, for example Hetzner offers bare metal servers as well as cloud instances at a very reasonable price.
(Not affiliated in any way. Just a happy customer.)