This is interesting. How do you "look for the moments worth recollecting?"
You might be interested in this (somewhat dated, from May 2012) slide deck of related work I'm doing: http://s3.amazonaws.com/vitorio/Automated%20Storytelling%20M...
I'd be interested in hearing more about your software if you'd care to share. My contact information is in my profile here.