For better or worse HN is run to meet YC's objectives. YC does not appear to value engagement for the sake of engagement very highly. People can disagree with that, But it remains a fact.
Most of the reasons dang put forth as to why he killed those particular threads could be applied to almost every thread on this site - depending entirely on the opinion of whomever happens to be reading them at the time.
Granted, you're right - it's YC's sandbox and they get to set the rules. But reading dang's post I can't help but wonder whether he's confusing diversion for intellectual quality.