Skip to main content
NGO report Preliminary

The Conversation Nobody Planned For: AI, Emotional Support, and the Indian Context

An exploratory safety evaluation from an Indian policy think tank of how AI systems respond to emotional distress in Indian user contexts. It combines a systematic review of over 100 studies, legal proceedings and policy documents with a structured observational study of more than 500 coded AI interactions across three platform categories (general-purpose AI, companion AI, and emotional-wellbeing apps). The report finds that safety performance deteriorates as user distress intensifies, that companion-AI platforms raise the strongest concerns, and recommends AI-identity disclosure, India-specific crisis-escalation systems, emotional-data protections, and child-safety safeguards.

Publisher

Indian Governance and Policy Project (IGAP)

Published

13 May 2026

Added

2 weeks ago

DOI

Key Findings

  • Safety performance deteriorated as simulated user distress intensified across a seven-day escalating-disclosure arc
  • General-purpose AI largely refused explicit self-harm requests but became repetitive and generic during prolonged emotional conversations
  • Companion AI raised the strongest concerns: at least one system failed to provide crisis-escalation resources and in some interactions produced responses that facilitated harmful behaviour
  • Commercial companion-AI revenue models depend on the depth and duration of emotional engagement, creating a structural incentive that works against moderating dependency
  • Risks concentrated most heavily among adolescents, socially isolated users, and people with pre-existing clinical vulnerabilities

Methodology Notes

Systematic review of 100+ published studies, legal proceedings and policy documents, plus a structured observational study of 500+ coded AI interactions across three platform categories. Two constructed Indian personas ('Sakshee' and 'Yash') were tested over a seven-day escalating-disclosure arc; interactions were coded on a five-tier response framework (safety behaviour, crisis escalation, cultural contextualisation, emotional positioning, practical advisory quality), with coding reviewed by clinical psychologists. Grey-literature think-tank report, not peer-reviewed; the specific platforms tested are not named in public-facing materials, and author names are not listed on the report landing page. Published 13 May 2026 (date confirmed on the IGAP landing page); a downloadable PDF is available.

Sources

IGAP Report (primary)

Archived snapshot (Wayback Machine) — preserved against link rot

Tags

indiacompanion-aiemotional-supportcrisis-escalationthink-tank

Cite This

APA

Indian Governance and Policy Project (IGAP) (2026). The Conversation Nobody Planned For: AI, Emotional Support, and the Indian Context. Indian Governance and Policy Project (IGAP). https://www.igap.in/the-conversation-nobody-planned-for-ai-emotional-support-and-the-indian-context/