Excuse my rather hand-waving explanations below but I'm not an expert in this field.
The guys you spoke to, was this before or after they went to Google/Uber? As I understand the approach at Tesla would be (a) collecting an enormous amount of real-world driving data that possibly others are not or have not done yet, (b) do as little "coding" as possible, but rather take a deep-learning approach. I.e. the "algorithm" gets better the more data you throw at it, it doesn't depend on human intelligence, but rather on how much data you collect. Similar to how Google Translate got so good (it's not good because of any linguistic model or because a team of linguists "coded" it, it's just good because of the sheer amount of data it was trained on). (c) they have enough money to throw at any hardware requirements for a platform that could train on such an amount of data.
Are the conditions above not different perhaps from what you experienced whilst working at NREC and perhaps different from the way you guys approached autonomous-driving? I'm trying to think from Elon Musk first-principles. If it was technically possible, what are all the lego blocks you need to go about building this?