This kind of problem seems more widespread than only in the medical field. This stuff just reminds me of what Doug Englebart was trying to do with his NLS system. Augmenting Human intelligence. Were reaching the limits of what single humans are cable of retaining and processing in their daily jobs. I think that it's time for stuff Englebart did in the 60s to be rediscovered. While the internet is great, it's potential hasn't been maximised in area like this. Englebart's vision went much further than just google. Wolfram alpha is getting close to this in a way but still not far enough. I'm sure someone is already starting to develop this stuff (post some links if you have any).
I can just imagine an iPad application (preferably android table app ;p) for doctors which implements the system I talked about at the beginning of this post. Giving doctors on the go access to a database of diseases and medical records of the patients and a way for the computer to anylisze the data and return the info right there (powered by a huge hadoop cluster). Typing a few symptoms, getting the list of possible diagnostics and viewing some checklist of things to do. This would in no way replace doctors, I don't believe that we have reached a point where you don't need a human person to judge the validity of the computer guesses. In fact, assessing the symptoms is probably going to require a trained professional for ages but, at the same time I think there is massive potential for this kind of AI in these information intensive fields.
There is definitively lots of startup potential in all this.
I see a lot of startups solving easy problems (for good reasons) but this is worth a 10 twitters in value.
If I wasn't doing stuff in the medical imaging field (Brain imaging specifically) I'd go out and build this.
Oh, good. Seems every episode of House I watched would contain a scene that began with, "Differential diagnosis for shoulder pain, go!" And then they'd spend ten minutes listing off all the diseases that could cause it. And I'd spend ten minutes thinking "You people really need a database."
I keep reading comments like this and am wondering if anyone has been to an HMO in the past 5 years. This is part of any GP's office with a full EPIC install. I guess many probably don't use it, unless they are forced to. Just wanted to point out this tech already exists in a commercial product. It's not wonderful, it actually kind of sucks. I also wonder why hackers think software like this is going to have "incredible potential," or even be "good."
It was able to outperform pathologists in the area it was designed for because (or so I've been told) it didn't face the cognitive biases that human doctors have (like the inability to reason with probabilities, the accessibility bias, etc).
"I don't know."
What worries me are those that attempt to fake it instead.
Why are we not using expert systems?
Imagine a Netflix challenge for catching medication problems using customer case files. "Your patient had his spleen removed but is not receiving medication to compensate." should be displayed along side the case so every reviewer would see these recommendations.
I've dealt with many other specialist and GPs since then and there's always that omniscient, arrogant attitude from them, especially when they don't have an easy answer for you. I've also watched a few people go through medical school and seen them gradually become like this as well.
It's a world apart, but IT and software development practices have matured over the last 10+ years and have been forced (sometimes catalysed by business requirements e.g. Sarbanes Oxley) to adopt standards, practices and more thorough documentation than previously.
Personally for me it's a narcissistic thrill thinking that you can invent something brand new or solve some problem that someone else couldn't. For me then, the standardisation, extra documentation and the increasing amount of lego-brick style clicking together of existing pieces of wizardry that someone else has built have made IT less exciting.
Of course I could go build an incredible open source something or other in my own time but narcissism is about _delusions_ of grandeur, not actual grandeur ;)
So the bush I'm beating around is that maybe personal and collective arrogance of medical practitioners has blocked this kind of thing being implemented before?
Eastern cultures are much less individualistic - they seem to rely much less on individuals to creatively and independently figure things out in so many fields and situations, preferring to defer to tradition, or predefined rules, or an authority.
I'm not saying doctors are irresponsibly arrogant, they do amazing work, most are thoughtful, compassionate and insanely dedicated people who commit their entire lives to what they do.
But is the mindset that the rarefied world of medicine and its practitioners being so important and sophisticated that every situation requires years of education and experience to manage holding it back?
It's working, though. Care is getting better than ever. Science is progressing faster than ever. We just need more. More funding, more education, more scientists, more talent. Especially in biology, we need a lot more computer scientists, especially the theoretical kind. A probabilistic pi-calculus would do wonders for dealing with the sorts of errors that cost Duane Smith his digits. We need more mathematicians to help us handle systems of vast and irreducible complexity, and we need more truly excellent experimentalists to pull off what was thought impossible.
That's what will help medicine the most, I think. More and better science, and intelligent people thinking rigorously about process. It costs money. My "one wish" would be to redirect the resources we've wasted in our War on Drugs, and the War on Terrorism / the Middle-East, and throw it all at the War on Human Ignorance. In truth, it's amazing how cheap progress is. The cost of developing a new cancer drug is way less than the cost of invading Iraq. It's actually cheaper to save lives rather than kill people!
This post doesn't really have a point. I just wanted to express my vote of total optimism for science in these days of rampant pessimism. It works, it's actually pretty cheap, and it gives back a thousand times more than what we put in. If you're in college and you're reading this, please become a scientist (or a doctor) :)
All the math I learned in school (I have a BS in math) seemed so small compared to the stuff I see used in the research the folks in my lab are doing. There is a great need of skilled mathematicians and comp sci folks in these bio based fields, as you pointed out. Biologist are smart people but when it comes to comp sci their cs skill sets are not always large enough for their need. That's where p eople like us fill in the blanks.
Kaiser does seem to be making progress here, but I'm not sure how fast it is.
Interperson coordination. I want it for small team IT project work, they want it for multiteam medicinal work.
We have decent task schedulers in computers at the kernel level, multiple processes, multiple threads, RPC, yet in people terms we're still on email, shared docs, waves, CRUD-dy database frontends with no central driver.
And I don't want to be the central project manager myself, tracking lots of data and sorting it into order - that's machine work.