Juergen Schmidhuber and his students came up with much of the basic NN elements, such as RNN, LSTM and others without behemoth resources (and several years earlier). Ttbomk, the one thing they DIDN’T come up with was the transformer; however it is very likely someone would have within a 5-10 year time frame.