VisualizationsDeep Learning
Activation Functions
Compare ReLU, Sigmoid, Tanh, GELU and friends — with their derivatives — and hover to read exact values.
f(x) — GELUf′(x) — derivative
Related topics: Neural Networks
Compare ReLU, Sigmoid, Tanh, GELU and friends — with their derivatives — and hover to read exact values.