As I understand it, the whole aim of agriculture is reduced energy per unit output. The reason some US farmland lies dormant is, its slightly less productive per unit effort.
Further, any other high-tech food solution (electric boxes that grow lettuce under lights etc) is more energy-expensive. Can't bean letting Mother Nature do all the work, and just driving by later and picking up the food.
Also there is a surfeit of farmland (read: food production) in the US. Iowa produces enough calories to feed 2 United States all by itself. The feds pay to leave 10% of Iowa fallow. Not as a soil-conservation effort (though that is a result) but instead to control supply. Which is yards cheaper than trying to support prices. So that's part of it too.