When Rubrics Fail: Hallucinations Reveal Blind Spots in Medical AI Evaluation

Key Findings

• — Clinically relevant hallucinations injected into otherwise correct responses were often missed by the rubrics of HealthBench, HealthBench Professional and LiveMedBench, frequently leaving scores unchanged.
• — Rubrics were most effective when explicitly checking facts and least effective for additional or unexpected errors they did not anticipate.
• — In a controlled MedHallu setting, more specific rubrics distinguished correct from hallucinated responses better than generic ones.
• — A preliminary retrieval-based factuality check recovered some rubric-blind errors, suggesting a complementary layer.
• — The authors conclude rubric scores alone are insufficient to establish clinical reliability and may undermine clinician trust if relied on for deployment decisions.

Methodology Notes

Evaluation-methodology study: taxonomy of medical hallucination types, clinician-validated error-injection pipeline producing matched response pairs, applied to three rubric-scored medical benchmarks; details of clinician validation and model coverage are in the paper body, not the abstract. arXiv v1 2026-09-11 (14 September partition); all seven authors at the University of Oxford per the PDF title block; no venue stated.

Sources