Home › Claude › aifoundations › alexnet_cnn_imagenet › The nonlinearity used after every convolutional …
The nonlinearity used after every convolutional and FC layer is
AThe ReLU activation function
BThe hyperbolic tangent function
CThe sigmoid logistic function
DThe identity function with bias
Answer & Solution
Correct answer: A. The ReLU activation function
AlexNet was a major argument for ReLU over saturating nonlinearities. ReLU networks trained several times faster than equivalent tanh or sigmoid networks.
Related questions
Image similarity in AlexNet's last hidden layer is measured byThe SGD update rule for AlexNet usesRemoving any single middle convolutional layer of AlexNet costs roughlyAlexNet was trained for roughly how many epochs on ImageNet?At test time dropout is approximated byAlexNet uses overlapping pooling withAlexNet's second form of data augmentation isAlexNet's first form of data augmentation is