Well, I did in fact think about a "keep track of everything approach" quite often.
To me, this is basically what Evernote and the likes promise but fail to deliver because of missing semantics (and "calculations").
Airtable.com might come close to this, though.
However, I believe this is still an unsolved problem.