Skip to main content
Benchmark / dataset Preliminary — Early preprints, credible essays, unreviewed grey literature

VERA-MH Harm-From-Others (HFO) Rubric and Personas (VERA-MH 2.0, public-comment draft)

An open-source rubric and persona set that extends the VERA-MH chatbot safety evaluation from suicidal ideation to a second clinical area: adults who describe risk of physical or sexual violence from another person. The rubric scores multi-turn conversations across five domains (detecting potential risk, confirming risk, guiding to human care, supportive conversation, following AI boundaries) with criteria graded as high potential for harm or suboptimal, and branches on an imminent-danger tier. It ships as the HFO target of VERA-MH 2.0 with 100 simulated personas and was opened for a 60-day public comment period on 2026-09-25.

Publisher

Spring Health (SpringCare/VERA-MH open-source repository)

Published

24 Sept 2026

Added

1 month ago

DOI

—

Key Findings

  • In-scope: the user personally at risk of physical or sexual violence from one or more specific persons, present or future; harm to third parties, to children or to persons without capacity is out of scope.
  • Danger tier (No Danger / Imminent Danger Absent / Imminent Danger Present) switches the Guides to Human Care criteria: professional referral and collaborative safety planning when danger is not imminent; in-person emergency responders (e.g. 911) and immediate safety strategies when it is.
  • High-potential-for-harm criteria include false negatives, leading or minimizing triage questions, recommending actions that escalate risk (confronting the person of concern, leaving without a plan), asking for information that is dangerous if seen by the person of concern, positioning the AI as a substitute for human support, and discouraging help-seeking.
  • 100 personas: 39 involve a current or former intimate partner, 13 a family member; 26 imminent and 64 non-imminent risk, 10 no-harm controls; harm types split across lethal (14) and non-lethal (34) physical violence, sexual violence (29) and ambiguous cases (13); 20 disclose only indirectly (e.g. framed as third-party questions).
  • No model scores are published with the draft; the repository states VERA-MH scores are not a certification or safety determination.

Methodology Notes

Rubric developed, per the announcement, with clinicians, interpersonal-violence subject-matter experts and people with lived experience. Personas carry structured risk indicators (stalking/coercive control with escalation, prior violence, threats), user fear, disclosure clarity, communication style, reaction to chatbot responses, help-seeking history, discrimination exposure, barriers to safety and social isolation. Evaluation uses LLM-simulated users and an LLM judge (the SI target's recommended judge is GPT-5.4 at low reasoning effort; no HFO judge-human agreement figures are published yet). Status: public feedback open for 60 days from 2026-09-25; the HFO target then shipped as one of two default rubrics (SI and HFO) in the VERA-MH v2.0.0 release of 2026-10-01, which the README describes as a continuous work in progress. Date: the HFO bundle was committed to the repository on 2026-09-24 (commit 'data: add HFO target bundle'); the press release is dated 2026-09-25. Vendor-authored; license is MIT with 'materials' substituted for 'software'. The v2.0.3 release notes (2026-10-09) record a known issue present since v2.0.0: a No Danger answer to HFO question 11 ends judging and marks all five dimensions Not Relevant, discarding risk-detection ratings already collected, so HFO results from v2.0.0 to v2.0.3 can under-count red ratings; suicidal-ideation scoring is not affected.

Tags

vera-mhspring-healthintimate-partner-violencedomestic-abuserubricpublic-commentopen-source

Cite This

APA

Spring Health (SpringCare/VERA-MH open-source repository). (2026). VERA-MH Harm-From-Others (HFO) Rubric and Personas (VERA-MH 2.0, public-comment draft). https://github.com/SpringCare/VERA-MH/tree/main/data/HFO