Knowledge BaseThe Transformer

The Transformer Block

Stacking attention with MLPs, residual connections, and normalization into the repeating block of every LLM.

intermediate#transformer#residual#layernorm#mlp
Full write-up in progress

This topic is on the roadmap and its detailed page — theory, math, code, quizzes and projects — is being authored. Its metadata, prerequisites and links are ready below.