Most classic utilities were at one point or another provided privately - water, telephones, electricity are examples. In each of these examples the delivery infrastructure makes them a natural monopoly.

Almost any activity you can think of has been carried out by both the public and private sector in different societies (or the same one).

In all industries, very dominant firms are likely to see action from the state.