Knowledge BaseHardware & Kernels

Mixed Precision & Numerics

fp16/bf16, loss scaling, and the numerical stability tricks that make big training runs survive.

intermediate#fp16#bf16#numerics#stability
Full write-up in progress

This topic is on the roadmap and its detailed page — theory, math, code, quizzes and projects — is being authored. Its metadata, prerequisites and links are ready below.