Home › Claude › aifoundations › many_shot_in_context_learning › The model used for many-shot experiments is
The model used for many-shot experiments is
AGPT-3 with the 2k token context window
BClaude 2 with the 100k token context window
CGemini 1.5 Pro with 1M token context
DLlama 2 with the 4k token context window
Answer & Solution
Correct answer: C. Gemini 1.5 Pro with 1M token context
The 1M-token context of Gemini 1.5 Pro enables many-shot regimes with up to thousands of examples. Earlier models like GPT-3 (2k) and Llama 2 (4k) cannot fit the long prompts.
Related questions
The implication for prompt design when shots are abundant isAn architectural risk of many-shot ICL exposed by the XSum result isWhy is many-shot ICL practically more attractive than fine-tuning?Long-context scaling laws (next-token loss)Many-shot ICL can overcomeMany-shot ICL can perform comparably toThe order of examples in many-shot promptsAbstractive summarization on XSum