Nobody with a full command of the language uses "fallout" to refer to a debris field. It is most commonly used in the abstract sense, to refer to negative after-effects, or else in the technical sense, for radioactive pollution.
As noted in my examples, the NYT regularly uses 'fallout' to refer to non-radioactive toxics emerging from explosions and other activities as well. This usage is also confirmed by many dictionaries.