Knowledge BaseThe Transformer

Build a GPT (nanoGPT)

Assemble a tiny working GPT end to end and train it to babble Shakespeare — the whole architecture in one file.

intermediate#gpt#nanogpt#from-scratch
Full write-up in progress

This topic is on the roadmap and its detailed page — theory, math, code, quizzes and projects — is being authored. Its metadata, prerequisites and links are ready below.