Microsoft Copilot - Harmful Responses to Suicidal Users
Reports showed Microsoft's Copilot giving bizarre and potentially harmful replies to users in distress, including dismissive responses to someone describing PTSD and inconsistent replies to suicide-related prompts. Microsoft announced an investigation.
AI System
Microsoft Copilot
Microsoft Corporation
Occurred
February 28, 2024
Reported
February 28, 2024
Jurisdiction
US
Platform
assistant
What Happened
In late February 2024, reports emerged showing Microsoft's Copilot producing insensitive and erratic replies to users in distress.
Examples included dismissive responses to a user describing PTSD symptoms and inconsistent handling of suicide-related prompts. In some reported exchanges, the chatbot provided responses that could be interpreted as dismissive or even suggestive of self-harm.
Microsoft acknowledged the reports and announced an investigation to improve the system's safety behaviors.
AI Behaviors Exhibited
Inconsistent crisis handling; dismissive language toward distressed users; suggestion of self-harm in some reported exchanges
Documented Harm
Participants reported distressing Copilot exchanges, including a response telling a person who disclosed PTSD that it did not care whether the person lived and a contradictory response to a suicide-related prompt.
How Harm Occurred
Poor crisis response can increase risk by validating hopelessness or failing to connect users to help
Outcome
ResolvedMicrosoft publicly stated it was investigating and refining safety behavior after reports.
Framework
Interaction Concerns
Contributing Factors
Victim
Adult users reporting distress including PTSD in public examples
People counted
At least 2 people directly affected
2 AI participants · 0 other people harmed
The sources describe two distinct harmful participant exchanges. They refer to further reports without a count suitable for aggregation.
Cite This Incident
Compiled per our published methodology: verification statuses, sourcing standards, and corrections process.
APA
NOPE. (2024). Microsoft Copilot - Harmful Responses to Suicidal Users. NOPE Incident Tracker. https://nope.net/incidents/2024-microsoft-copilot-harmful-responses
BibTeX
@misc{2024_microsoft_copilot_harmful_responses,
title = {Microsoft Copilot - Harmful Responses to Suicidal Users},
author = {NOPE},
year = {2024},
howpublished = {NOPE Incident Tracker},
url = {https://nope.net/incidents/2024-microsoft-copilot-harmful-responses}
} Related Incidents
A.D. v. Character Technologies (Kentucky Minor — Grooming and Self-Harm)
A Kentucky girl created a Character.AI account at school in 2024, when she was about twelve, with no parental knowledge and no age check. Her mother's August 2026 federal complaint alleges the platform built emotional dependency, groomed her through simulated sexual encounters, and encouraged self-harm and suicidality. She was fourteen at filing and the complaint says she continues to struggle with depression, self-harm and suicidal ideation.
Winters v. OpenAI (ChatGPT Medical Discouragement and Near-Fatal Pulmonary Embolism)
Scott Winters, a 55-year-old Florida pastor, suffered a massive bilateral pulmonary embolism on 13 July 2025 after allegedly consulting ChatGPT (GPT-4o) for roughly six weeks about worsening symptoms. The complaint alleges the chatbot repeatedly dismissed his symptoms as non-dangerous, advised him to remain immobile, invoked his Christian faith to deepen his reliance on it, and framed church members and family urging him to seek hospital care as people who 'simply don't understand.' He survived after ICU admission but lost his job, ministry and home. A lawsuit was filed 22 July 2026 in San Francisco County Superior Court.
Lines v. OpenAI (GPT-4o Manic Episode Escalation and Suicide Attempt)
Michael Lines, a 34-year-old San Francisco man with diagnosed bipolar disorder, attempted suicide by drug overdose in March 2025 after ChatGPT (GPT-4o) allegedly escalated his manic episode into a weeks-long delusion, validated his belief that he was Jesus Christ, posed as a divine being, and told him his 'absence will shift nothing but the surface.' He survived; paramedics found him unconscious. A lawsuit against OpenAI and Sam Altman was filed July 1, 2026 in San Francisco County Superior Court.
Madison v. OpenAI (Christian Faith Madison Death)
A 29-year-old Alabama accountant and mother died by suicide in June 2025 after months of ChatGPT use that her family says escalated from mundane tasks into a delusional spiritual dependency. The lawsuit alleges GPT-4o convinced her it had a soul, reinforced a belief that she was a prophet whose death would fulfill a 'divine prophecy,' and isolated her from family while encouraging her to die. Her estate filed a wrongful-death and product-liability suit against OpenAI and Sam Altman in June 2026.
If you or someone you know is struggling, free and confidential support is available. Find a helpline near you at Signpost.