Claude instructgpt_rlhf — practice questions
15 free MCQs with worked solutions. Tap any question for the answer + explanation, or practice them all in the app.
Practice Claude instructgpt_rlhf in the app →InstructGPT is trained by which three high-level steps?The base pretrained model fine-tuned for InstructGPT isThe reward model is trained onThe final RL step uses which algorithm to optimise the policy?The alignment goal is summarised as the model beingHow many human contractors were hired to label data?The PPO objective includes a KL penalty against the SFT model to'PPO-ptx' differs from plain PPO byThe RM training pairwise loss function usesRM training uses all C(K,2) comparisons from a single prompt asInter-annotator agreement among training labelers is roughlyRM models in InstructGPT are sized atPrioritising helpfulness during training while prioritising harmlessness at evaluation is justified becauseWhy is honesty measured via 'truthfulness' rather than directly?The FLAN and T0 datasets are mentioned as baselines because they