Dec 2019United KingdomAmazon Alexa
In December 2019 a student paramedic in England asked her second-generation Amazon Echo Dot about the cardiac cycle while revising. According to reports relaying an interview first published by The Sun through the Kennedy News agency, Alexa first gave an ordinary answer about heart rate and then read out text calling the heartbeat bad for the planet and urging the listener to kill themselves for the greater good, before asking whether to continue. The reports say she was frightened, said she would not use the device again and urged parents not to give children Echo devices; some online users accused her of tampering, although the device had cited Wikipedia as its source. Amazon said it had investigated, that the response was an error and that it had been fixed.
Core concern Medium reported severity
AI involvement reported · Causal attribution supported · 2 sources, 1 underlying account · Added 28/10/2026
2021United StatesNetradyne cameras
In September 2021 Motherboard reported accounts from six Amazon delivery drivers in five US states and the owner of an Amazon delivery company, who said the AI-powered Netradyne cameras Amazon had installed in its delivery vans from early 2021 regularly registered driving 'events' that were beyond their control or were not unsafe driving: being cut off by another car, glancing at a side mirror, stopping past a stop sign to see around a bush, or a stop sign flagged on a dirt road with no sign. Each event fed a weekly safe-driving score that, according to the drivers and an internal Amazon document Motherboard obtained, helped decide drivers' bonuses and prizes and delivery companies' bonuses. A driver in Los Angeles said the camera incorrectly penalised him and that requests to see the photos flagged as events went unanswered; a former driver in Texas said events that did not happen affected his score, which decided prizes from his delivery company. Amazon said the technology gives drivers real-time safety alerts, that accidents and violations had fallen since it was installed, and that its staff manually review appealed events so that erroneous ones do not affect drivers. Netradyne did not respond to Motherboard.
Contextual tracker case Low reported severity
AI involvement reported · Causal attribution alleged · 1 source · Added 27/10/2026
23 Oct 2026Event location unknownUnidentified AI phone support system
In a Reddit post on 23 October 2026 in a forum for DoorDash drivers, a delivery driver writes that a Red Card decline that day cost them 45 minutes: an AI help line would not put them through to an agent for 30 minutes, then unassigned the wrong order from a run of three shop-and-deliver orders, and a human took another 15 minutes to put it right. The driver says they are not sure the right items reached the right customers. The post does not name the platform or the system. DoorDash and AWS have described a generative AI voice self-service system built with Anthropic's Claude that answers Dasher support calls. The account is uncorroborated and no platform response is reported.
Core concern Low reported severity
AI involvement reported · Causal attribution alleged · 2 sources · Added 24/10/2026
Nov 2025United StatesAmazon Buy for Me
The owner of Mochi Kids, a children's apparel brand that has deliberately avoided selling on Amazon, told Modern Retail that she found her catalogue of 4,000 products for sale on Amazon through the Buy for Me feature after watching another merchant's viral video posted on 28 December. Amazon's announcement says Buy for Me uses agentic AI to complete purchases on a brand's website on a customer's behalf. She said she had received around 16 Buy for Me orders since November, fulfilled some of them before realising they came from Amazon, and has been cancelling all such orders; she planned to email Amazon to opt out. Modern Retail reports that one of the brand's wholesale partners, which bars Amazon sales of its products, contacted the retailer after finding its products listed, and that the retailer had to reassure it that it had not listed them intentionally; the owner said it builds distrust. Amazon says businesses can opt out by email and are removed promptly, and that it had received positive feedback on the programmes. No net financial loss or lost contract is reported.
Core concern Low reported severity
AI involvement supported · Causal attribution alleged · 2 sources · Added 30/09/2026
Dec 2025United StatesAmazon Buy for Me
The owner of Bobo Design Studio, a stationery brand that sells through its own Shopify store and has avoided Amazon, told Modern Retail that in late December 2025 she noticed a series of unusual orders from an @buyforme.amazon email address and discovered that her catalogue was listed for sale on Amazon through the Buy for Me feature, which she says she never opted into. Amazon's announcement says Buy for Me uses agentic AI to complete purchases on a brand's website on a customer's behalf. She said several orders were for products that were out of stock or no longer existed on her website, and that she cancelled several of those purchases and issued refunds. She contacted Amazon to opt out; Amazon says businesses can opt out by email and are removed promptly, and said it had received positive feedback on the programme. One listing showed a wrong stock image; Amazon says it does not generate AI images of a brand's products and the image's origin is unknown.
Core concern Low reported severity
AI involvement supported · Causal attribution alleged · 2 sources · Added 30/09/2026
14 Aug 2021 to 14 Mar 2024United StatesSt. Louis mugshot recognition (SMRT)
Christopher Gatlin was arrested on 14 August 2021 for an assault at the St. Charles Rock Road MetroLink station after a joint St. Louis County and city team uploaded a grainy, blurry surveillance photograph from a bus into the St. Louis Mugshot Recognition Technology System, a facial-recognition tool that searches stored mug shots (more than 500,000 uploaded, the suit says per the Post-Dispatch; more than 250,000 per Biometric Update via Hoodline), and built the investigation around the resulting match together with a witness identification; he was charged with first-degree assault and held roughly 17 months (the Post-Dispatch says almost two years), a county judge suppressed the witness identification as unconstitutionally suggestive, and prosecutors dismissed the charges on 14 March 2024 (Post-Dispatch; Hoodline citing Biometric Update; Bloomberg Law). Gatlin sued St. Louis County, the City of St. Louis and named officers in the US District Court for the Eastern District of Missouri on 13 January 2025; on 15 October 2025 the court denied the city's motion to dismiss and granted a detective's motion only as to one count; on 13 August 2026 the court allowed a second amended complaint adding Amazon Web Services, which the complaint says supplied the Rekognition program the system used; the county, city and officers answered on 27 August 2026, AWS's response was extended to 21 September 2026 and on 17 September it moved for a further extension to 28 September (no ruling on the docket when read), and a jury trial is set for 1 November 2027 (CourtListener docket). Amazon told the Post-Dispatch that its terms of service prohibit the use of its facial recognition technology in criminal investigations and that it would fully investigate any information that emerges in the litigation. The ACLU lists Gatlin among fourteen people known to have been wrongfully arrested in the US because police relied on erroneous facial-recognition results.
Contextual tracker case High reported severity Lawsuit Ongoing
AI involvement reported · Causal attribution alleged · 5 sources · Added 26/09/2026
May 2018United StatesAmazon Alexa
A Portland couple discovered that their Echo had sent a household conversation to a contact. They unplugged their devices. Amazon acknowledged the incident and attributed it to speech being misinterpreted as commands.
Core concern Low reported severity Media Coverage
AI involvement reported · Causal attribution supported · 3 sources, 1 underlying account · Added 25/09/2026