Because changing the crop a whole country lives of requires enormous changes in the agricultural infrastructure. Years of trial and error and lots of valuable knowledge farmers have about growing the currently common crops would become less valuable.
Point is: It would lead to lower crop yields, at a higher cost.
That's doesn't mean instant death for all humans on the face of the earth. But it's still something we want to avoid.
Acting to prevent climate change is a cost saving measure.