A mathematician's introduction to transformers and large language models (opens in new tab)

This is a very good summary with great narrative, helpful diagrams, and very approachable math explained clearly. Good references. Well worth the read.