Flip and match each activation

Exercise and reference answers

Matching pairs

1. A

   ReLU

   B

   max of x and zero

2. A

   Sigmoid

   B

   Zero to one range

3. A

   Tanh

   B

   Minus one to one

4. A

   pReLU

   B

   Leaks negatives

5. A

   Hard threshold

   B

   No usable gradient

Instructions

Flip two cards to pair an activation function with the range or slope it produces.

Explanation