The engineering that trains and serves frontier models — GPUs and CUDA, distributed training, parallelism (FSDP/ZeRO), mixed precision, and inference optimization.
—
Hardware & Kernels
GPUs, CUDA & Kernels
6hintermediate
Hardware & Kernels
Mixed Precision & Numerics
3h 40mintermediate
Hardware & Kernels
Memory & Profiling
3h 40mintermediate
Data at Scale
Data Pipelines & Large-Scale ETL
4h 40mintermediate
Training at Scale
Distributed Training
6hadvanced
Training at Scale
Data, Tensor & Pipeline Parallelism
5h 20madvanced
Training at Scale
FSDP, ZeRO & Sharded Training
5hadvanced
Serving & Ops
Inference Optimization
4h 40madvanced
Serving & Ops
Quantization & Compression
4h 20madvanced
Serving & Ops
MLOps & Reproducibility
4h 20mintermediate
Press enter or space to select a node. You can then use the arrow keys to move the node around. Press delete to remove it and escape to cancel.
Press enter or space to select an edge. You can then press delete to remove it or escape to cancel.