There was a noticable (and well recorded) change in the climate for awhile when Ghenghis Khan went on his rampage. And he was a lot less effective at killing people than novel old world diseases.

It doesn’t seem completely implausible.