It has to do with both, but the rate of growth of knowledge and progress have been made possible by the abundance of energy. If you remove energy even in a developed society, people go back to surviving.