Self-Attention from Scratch
How every token looks at every other token to decide what matters — the core idea of the Transformer.
intermediate#attention#self-attention#qkv
Full write-up in progress
This topic is on the roadmap and its detailed page — theory, math, code, quizzes and projects — is being authored. Its metadata, prerequisites and links are ready below.