Deepmind is Google but only one aspect. Much of the best research does not even come from the Deepmind unit.
Nvidia had zero papers at NIPS accepted. Plus GANs, Capsule networks, AlphaGo and so many other breakthroughs come from Google.
But maybe I am just unaware. Can you provide some breakthroughs from Nvidia? Maybe I am just unaware?
SDC will be winner take all and Waymo is literally miles ahead of everyone else.
We have recent benchmarks done on Nvidia versus the TPUs and the TPUs are about 1/2 the price of using Nvidia for the same amount of work. That is a big advantage for Google.
But also that was gen 2 and suspect we will see a gen 3 soon which will be another step forward. Nvidia will constantly be trying to catch up.
"I will bet you that 2 years down the line, Nvidia will have abandoned its own TPU project and all major players just buying Nvidia chips "
This does not make sense to me and think you had a typo?
BTW, Unless Nvidia makes major advancement Google just could never use Nvidia for their own stuff. The cost would just be way too high. Perfect example is the new Google text to speech using a NN at 16k samples a second. There is just no way Google could have used Nvidia and offer at a competitive price. The joules per inference is just way too expensive with Nvidia.
Google would have loved to buy chips for their stuff from Nvidia. Problem is they just do not have anything they could use at a price they could offer at scale.
So unless Nvidia catches up you will not see Google use Nvidia for their services.
The big new advancement I suspect we will see with Gen 3 is different memory architecture to better support dynamic routing with Capsule networks which came from Hinton.
Then it will be a couple of years before we see the same from Nvidia.
BTW, what is different is nobody is going to be tied to any chip architecture like we had with Intel. Those days are gone. The common layer will be TF. Now has over 98k stars on GitHub.
Besides K8s what else got to 100k stars faster.
