Activation Function
A
Activation Function
Definition
A mathematical function applied to a neuron's output in a neural network that introduces non-linearity, enabling the network to learn complex patterns. Common activation functions include ReLU, sigmoid, tanh, and GELU.