Here is just one recent example:
https://arxiv.org/abs/2210.13382If you actually follow the literature, you'll find that there is tons of evidence that the seemingly "simple" transformer architecture might actually work pretty similar to the way the human brain is believed to work.
