alleryStart learning →For an MLP layer with input X ∈ ℝⁿˣᵈ, hidden width h and output q, the weight shapes are
AW¹ ∈ ℝᵈˣⁿ and W² ∈ ℝⁿˣᵠ
BW¹ ∈ ℝᵈˣʰ and W² ∈ ℝʰˣᵠ
CW¹ ∈ ℝʰˣᵈ and W² ∈ ℝᵠˣʰ
DW¹ ∈ ℝⁿˣʰ and W² ∈ ℝʰˣⁿ
Answer & Solution
Correct answer: B. W¹ ∈ ℝᵈˣʰ and W² ∈ ℝʰˣᵠ
Hidden layer maps d inputs to h units, so W¹ ∈ ℝᵈˣʰ.
Output layer maps h hidden units to q outputs, so W² ∈ ℝʰˣᵠ.
Standard MLP forward-pass shapes.
Keep practising MLP and Activations
Browse all MLP and Activations questions for Claude, or explore more Aifoundations topics.
Related questions
Flip and match each activationWhy is the sigmoid prone to the vanishing-gradient problem?The derivative of sigmoid(x) equalsThe derivative of the ReLU function isThe tanh function squashes its input to which interval?The sigmoid function squashes its input to which interval?The ReLU activation function is defined asWhy does a stack of affine layers collapse without an activation function?