Home › Claude › aifoundations › instructgpt_rlhf › How many human contractors were hired to label d…
How many human contractors were hired to label data?
AAbout 400 contractors
BAbout 4000 contractors
CAbout 4 contractors
DAbout 40 contractors
Answer & Solution
Correct answer: D. About 40 contractors
About 40 contractors via Upwork and ScaleAI. They were screened on sensitivity to different demographic preferences and on identifying potentially harmful outputs.
Related questions
The FLAN and T0 datasets are mentioned as baselines because theyWhy is honesty measured via 'truthfulness' rather than directly?Prioritising helpfulness during training while prioritising harmlessness at evaluation is RM models in InstructGPT are sized atInter-annotator agreement among training labelers is roughlyRM training uses all C(K,2) comparisons from a single prompt asThe RM training pairwise loss function uses'PPO-ptx' differs from plain PPO by