Which concept describes over-reliance on AI that makes people accept AI judgments as correct without critical appraisal?

Get ready for the GARP Risk and AI Exam with flashcards and multiple choice questions. Each question comes with hints and explanations. Prepare for success!

Multiple Choice

Which concept describes over-reliance on AI that makes people accept AI judgments as correct without critical appraisal?

Automation bias is the tendency to rely on automated systems and accept their judgments as correct without sufficient critical evaluation. When AI or decision-support tools provide a verdict, people may stop scrutinizing the reasoning behind it, trust the output implicitly, and act as if the AI is infallible. This can happen because automation appears authoritative, fast, and consistently reliable, which reduces vigilance and cross-checking with other information sources. In practice, you might see risk assessments or fraud scores accepted at face value, with little effort to verify the AI’s reasoning or to consider potential errors. The dynamics here differ from skill atrophy, which is about losing manual capabilities from disuse; false confidence, while related, centers on overestimating one's own or the model’s accuracy in general, not the specific tendency to accept AI judgments without critique; and complacency, which is a broader drift toward reduced vigilance across tasks rather than a specific bias toward AI outputs. The key feature of automation bias is the uncritical acceptance of AI conclusions, often at the expense of independent judgment and verification.

Automation bias is the tendency to rely on automated systems and accept their judgments as correct without sufficient critical evaluation. When AI or decision-support tools provide a verdict, people may stop scrutinizing the reasoning behind it, trust the output implicitly, and act as if the AI is infallible. This can happen because automation appears authoritative, fast, and consistently reliable, which reduces vigilance and cross-checking with other information sources.

In practice, you might see risk assessments or fraud scores accepted at face value, with little effort to verify the AI’s reasoning or to consider potential errors. The dynamics here differ from skill atrophy, which is about losing manual capabilities from disuse; false confidence, while related, centers on overestimating one's own or the model’s accuracy in general, not the specific tendency to accept AI judgments without critique; and complacency, which is a broader drift toward reduced vigilance across tasks rather than a specific bias toward AI outputs. The key feature of automation bias is the uncritical acceptance of AI conclusions, often at the expense of independent judgment and verification.

More practice questions