When Is Disclosing Private Conversations with AI to the State Justified? Proactive Referral Policies of Major U.S. AI Companies through the Lens of Contextual Integrity

Key Findings

• — Three evaluators (one an author) analysed 27 public documents from six companies; no company clarified whether broad sharing provisions or narrower safety notices take precedence, and referral-scope results depend on which is given precedence.
• — No company disclosed the specific factual thresholds and exception conditions governing referral decisions, and no company stated that it notifies users after a referral, although five set out a principle of notifying users of government requests.
• — OpenAI alone restricted law-enforcement referral to risks to others, citing its August 2025 notice that it was "currently not referring self-harm cases to law enforcement"; for the other five, the documents do not rule out that a conversation revealing self-harm risk may be sent to law enforcement.
• — OpenAI was the only company that narrowed referral to imminent risks and the only one stating that humans decide whether to refer; no company stated that the target of the risk must be identifiable.
• — The authors recommend limiting law-enforcement referral to risks to others and routing self-harm risk to crisis support or emergency services instead (their Criterion 5, graded recommended).

Methodology Notes

Qualitative document analysis (Bowen 2009) using contextual-integrity information-flow elements; privacy policies, terms, safety notices, government-request policies and reports collected from company pages in October 2026 (access dates 9-11 October 2026 in references); U.S. versions only; precedence between general and referral-specific provisions is an analytical choice the authors flag as the reading most able to change results (Supplementary Table S6-1). Public documents only; actual referral volumes and practices are not observed. Not peer reviewed. Verified from the arXiv PDF v1. arXiv v1 created 2026-10-18 (Tuesday 20 October 2026 mailing). The abstract page returned 404 before the Tuesday announcement and resolved by 2026-10-22; v2 (2026-10-20) makes punctuation edits and adds an equal-contribution note.

Sources