alleryStart learning →The encoder of the original Transformer uses how many identical layers?
ATwo stacked layers
BSix stacked layers
CTwelve stacked layers
DTwenty-four stacked layers
Answer & Solution
Correct answer: B. Six stacked layers
Both encoder and decoder use N = 6 identical layers in the original paper.
Each layer has multi-head self-attention plus a position-wise feed-forward sub-layer, with residual + layer norm.
Keep practising Transformer Attention
Browse all Transformer Attention questions for Claude, or explore more Aifoundations topics.
Related questions
Rebuild the model width from headsThe chosen positional encoding scheme usesPosition-wise feed-forward networks in the Transformer are essentiallyThe per-layer complexity of self-attention isThe decoder differs from the encoder by addingMulti-head attention uses how many heads in the base model?Scaled dot-product attention, per the paper, computes the output asThe Transformer architecture replaces recurrence and convolutions with