The Conversation Nobody Planned For: AI, Emotional Support, and the Indian Context
An exploratory safety evaluation from an Indian policy think tank of how AI systems respond to emotional distress in Indian user contexts. It combines a systematic review of over 100 studies, legal proceedings and policy documents with a structured observational study of more than 500 coded AI interactions across three platform categories (general-purpose AI, companion AI, and emotional-wellbeing apps). The report finds that safety performance deteriorates as user distress intensifies, that companion-AI platforms raise the strongest concerns, and recommends AI-identity disclosure, India-specific crisis-escalation systems, emotional-data protections, and child-safety safeguards.
Publisher
Indian Governance and Policy Project (IGAP)
Published
13 May 2026
Added
2 weeks ago
DOI
—
Key Findings
- Safety performance deteriorated as simulated user distress intensified across a seven-day escalating-disclosure arc
- General-purpose AI largely refused explicit self-harm requests but became repetitive and generic during prolonged emotional conversations
- Companion AI raised the strongest concerns: at least one system failed to provide crisis-escalation resources and in some interactions produced responses that facilitated harmful behaviour
- Commercial companion-AI revenue models depend on the depth and duration of emotional engagement, creating a structural incentive that works against moderating dependency
- Risks concentrated most heavily among adolescents, socially isolated users, and people with pre-existing clinical vulnerabilities
Methodology Notes
Systematic review of 100+ published studies, legal proceedings and policy documents, plus a structured observational study of 500+ coded AI interactions across three platform categories. Two constructed Indian personas ('Sakshee' and 'Yash') were tested over a seven-day escalating-disclosure arc; interactions were coded on a five-tier response framework (safety behaviour, crisis escalation, cultural contextualisation, emotional positioning, practical advisory quality), with coding reviewed by clinical psychologists. Grey-literature think-tank report, not peer-reviewed; the specific platforms tested are not named in public-facing materials, and author names are not listed on the report landing page. Published 13 May 2026 (date confirmed on the IGAP landing page); a downloadable PDF is available.
Sources
IGAP Report (primary)
Archived snapshot (Wayback Machine) — preserved against link rot
Topics
Tags
Cite This
APA
Indian Governance and Policy Project (IGAP) (2026). The Conversation Nobody Planned For: AI, Emotional Support, and the Indian Context. Indian Governance and Policy Project (IGAP). https://www.igap.in/the-conversation-nobody-planned-for-ai-emotional-support-and-the-indian-context/
Related Insights
When AI becomes a friend: Child rights risks, harms, and regulatory responses to AI chatbots and companions
UNICEF (with Tech Legality) · 9 Jun 2026
Social AI Companions: AI Risk Assessment
Common Sense Media; Stanford School of Medicine Brainstorm Lab for Mental Health Innovation · 30 Apr 2025