Rebuild the model width from heads
Exercise and reference answers
- Sequence
- Item
- 64 dims
- Item
- 128 dims
- Item
- 256 dims
- Item
- 512 dims
- Instructions
- Drag one head width onto an equal head width until the eight heads add back to full width.
Explanation
_Source: Qallery verified question bank, AI Foundations, topic transformer_attention_