alleryStart learning →The nonlinearity used after every convolutional and FC layer is
AThe ReLU activation function
BThe hyperbolic tangent function
CThe sigmoid logistic function
DThe identity function with bias
Answer & Solution
Correct answer: A. The ReLU activation function
AlexNet was a major argument for ReLU over saturating nonlinearities.
ReLU networks trained several times faster than equivalent tanh or sigmoid networks.
Keep practising AlexNet CNN ImageNet
Browse all AlexNet CNN ImageNet questions for Claude, or explore more Aifoundations topics.
Related questions
Fill in the AlexNet numbersImage similarity in AlexNet's last hidden layer is measured byThe SGD update rule for AlexNet usesRemoving any single middle convolutional layer of AlexNet costs roughlyAlexNet was trained for roughly how many epochs on ImageNet?At test time dropout is approximated byAlexNet uses overlapping pooling withAlexNet's second form of data augmentation is