Preparing Practice Exam…
Please wait a moment while the system generates the exam questions, answers, and study session.
Please wait a moment while the system generates the exam questions, answers, and study session.
Question 15 of 44
Free Preview · 44 of 146 · questions 1–44 of 146 are free. Sign up free to sync your progress across devices.
Select 2 answers.
Written by other learners. Comments can disagree with the marked answer — check the official documentation when in doubt.
,B - Approval-rate parity measures whether groups receive positive recommendations at similar rates. It does not establish whether false approvals, false denials, sensitivity, specificity, or calibration are comparable across those groups. A system can therefore satisfy aggregate approval parity while imposing materially different error burdens on protected populations. The evaluation must include subgroup confusion matrices, false- positive and false-negative rates, calibration, intersectional analysis, and confidence intervals. The 94 percent agreement rate measures fidelity to human underwriter decisions, not fairness. Human decisions are not automatically unbiased ground truth. If historical underwriting practices contain structural, procedural, or measurement bias, a model that reproduces those decisions accurately can reproduce the same bias. The reference labels must therefore be independently assessed for legitimacy, consistency, and potential discriminatory effects. Nothing in the scenario establishes that protected groups were omitted, so D is unsupported. Similarly, sample size may require examination, but the scenario provides no statistical information proving that sample size is the principal deficiency. The evidence already contains two identifiable conceptual gaps regardless of sample size. Study Guide references/topics: [Defining multidimensional evaluation criteria](https://docs.anthropic.com/en /docs/build-with-claude/develop-tests); fairness measurement; subgroup error analysis; label and benchmark bias; human-baseline limitations; governance evidence.