alleryStart learning →The derivative of the ReLU function is
AAlways equal to 1 for all real x
BEqual to sigmoid(x) at every point
C1 if x > 0 and 0 if x < 0
DAlways equal to ReLU(x) itself
Answer & Solution
Correct answer: C. 1 if x > 0 and 0 if x < 0
d/dx ReLU(x) is 0 for x < 0 and 1 for x > 0. At x = 0 the derivative is technically undefined
in practice the left-hand value of 0 is used.
Keep practising MLP and Activations
Browse all MLP and Activations questions for Claude, or explore more Aifoundations topics.
Related questions
Flip and match each activationWhy is the sigmoid prone to the vanishing-gradient problem?For an MLP layer with input X ∈ ℝⁿˣᵈ, hidden width h and output q, the weight shapes areThe derivative of sigmoid(x) equalsThe tanh function squashes its input to which interval?The sigmoid function squashes its input to which interval?The ReLU activation function is defined asWhy does a stack of affine layers collapse without an activation function?