So you mean, grow much less of it, and at greater cost? You know what else presents a risk of "reduced IQs, memory and attention deficits"? Malnutrition, the world's most potent inhibitor of intelligence.
Just a note, the world runs no risk of malnutrition even if we produce less food with cleaner forms of production. The world already produces more than enough for everyone. The problem is distribution, not production.
Essentially, yes. The "green revolution" is an illusion and its effects cannot be sustained. We need to gradually back down to a place where humans can grow enough food for themselves without also poisoning themselves and without exhausting soil fertility.