alleryStart learning →The ReLU activation function is defined as
Amax(x, 0)
B1 / (1 + exp(-x))
Ctanh(x)
Dexp(-x)
Answer & Solution
Correct answer: A. max(x, 0)
ReLU(x) = max(x, 0) — keep positive values, zero out negatives.
Simple, fast, and the dominant activation in modern hidden layers.
Keep practising MLP and Activations
Browse all MLP and Activations questions for Claude, or explore more Aifoundations topics.
Related questions
Flip and match each activationWhy is the sigmoid prone to the vanishing-gradient problem?For an MLP layer with input X ∈ ℝⁿˣᵈ, hidden width h and output q, the weight shapes areThe derivative of sigmoid(x) equalsThe derivative of the ReLU function isThe tanh function squashes its input to which interval?The sigmoid function squashes its input to which interval?Why does a stack of affine layers collapse without an activation function?