Rule on these many shot claims

Exercise and reference answers

Questions

1. Statement is true

   Yes

   Statement

   Many shot prompts here run to thousands of examples.

2. Statement is true

   No

   Statement

   Summarisation on XSum keeps improving past fifty shots.

3. Statement is true

   Yes

   Statement

   Reinforced ICL swaps human rationales for model written ones.

4. Statement is true

   No

   Statement

   Example order stops mattering once you use many shots.

5. Statement is true

   Yes

   Statement

   Unsupervised ICL supplies problems without worked solutions.

6. Statement is true

   Yes

   Statement

   KV caching lets one long shared prefix be computed once.

7. Statement is true

   No

   Statement

   Next token loss reliably predicts in context reasoning gains.

Instructions

Tap true or false for each claim about prompts packed with hundreds of examples.

Explanation