It's mainly a problem for industrialized westerners. Go ask a herdsmen that spends all year outside and they'll have a fairly good memory for extreme weather events in the same way that you and I remember what the social climate of 2008 was like.
Anthropologists and biologists commonly track changes in floral/faunal ranges and ecosystems by asking the people who observe them daily.