I agree with your pragmatic approach. LLMs are a "high magnitude" advancement but we can't really correlate that with "severe destruction" in a physical way - maybe in a theoretical or abstract way.
Kind of reminds me of the whole "dihydrogen monoxide kills so many people per year" parody