There was a very good talk at NeurIPS this year that was comparing LLM training to amount of energy expended in building wonders of the world. I think this would’ve been a good thing to include too.