You can note that average male height in the US continued increasing up until the late 1980s.
That points to a general caloric deficit up until roughly 1990--which is roughly where we claim the "obesity epidemic" kicks off.
Also, a graph of sugar doesn't include caloric fillers like "soy protein" which now seems to be in everything.