18 Oct 2026AustraliaClaude (reported)
A man in Sydney's south was arrested on Sunday 18 October 2026 after Interpol flagged his interactions with Anthropic's Claude chatbot, and was charged with using a carriage service to menace, harass or offend, the Sydney Morning Herald reported from Sutherland Local Court on 19 October. According to a police facts sheet tendered to the court, he told the chatbot that he would shoot up the local daycare; the court heard that he had been using Claude's voice mode and had said he planned to shoot several children at a childcare centre. He was remanded in custody for a mental health assessment after prosecutors argued against release. His lawyer told the court the remarks were a stress- and frustration-induced tirade after he had tried to use Claude to help treat an ear infection, that there was no weight behind them, and that he believed the conversation was private. The court heard his Claude account was suspended. How the conversation reached Interpol is not reported.
Core concern Medium reported severity Criminal Charges
AI involvement reported · Causal attribution supported · 1 source · Added 19/10/2026
May 2026ChinaUnidentified video tool
The Beijing News reported on 16 October 2026, in an investigation of 'Xiaohai' accounts on Chinese short-video platforms, that the accounts show an AI-generated digital teenager who calls older women viewers 'aunties and mothers', tells stories of hardship and asks them to buy goods through sales links; its reporter generated such a video by following a tutorial, in a little over ten minutes. The paper describes a 79-year-old woman, given a pseudonym, who lived alone and talked most with the 'Xiaohai' on her phone. Around May 2026, according to the paper, a 'Xiaohai' video invited viewers to Yuncheng in Shanxi to see apricot blossoms; she secretly packed, bought a train ticket and set off with no clear route. On the train, railway police noticed her, told her that 'Xiaohai' was not a real person, and contacted her children, who bought her return ticket and brought her home. At first she refused to believe it. The paper also found that most 'Xiaohai' videos now carry a declaration that the content is AI-generated. How the paper learned of her journey is not stated. China National Radio (China Media Group) reported the same journey on 19 October 2026 with recorded exchanges between the woman and a train police officer: in May 2026 Urumqi railway police found a 79-year-old who cannot read travelling alone, able to say only that she was going to Yuncheng in Shanxi to see a child who called her 'auntie' every day on her phone; the officer told her the person in the live room was fake, and she got off and went home on a return ticket her family bought. The station's reporter found that the persona she trusted was one of the batch-produced 'digital human Xiaohai' accounts and that many carry an 'AI-generated' watermark in a corner of the video.
Core concern Low reported severity Media Coverage
AI involvement supported · Causal attribution alleged · 3 sources, 2 underlying accounts · Added 18/10/2026
2026United StatesUnidentified video tool
The Independence Institute, a libertarian-leaning Colorado think tank opposing Proposition NN on the November 2026 ballot, posted a video on its social media accounts in which an AI-generated likeness of Democratic state Sen. Cathy Kipp, who sponsored the bill that referred the measure to voters, appears as a grocery store clerk who keeps a customer's change and says it will help educate children. CBS Colorado reported that the institute made the video in response to remarks Kipp made on the Senate floor in April 2026. Kipp filed a campaign finance complaint with the Colorado Secretary of State's office on 5 August 2026, according to Colorado Newsline, alleging that the video lacked the disclosure a 2024 state law requires on deepfakes of candidates and officeholders; the video carried only a small line reading "AI generated content because who gets a human cashier these days?". Kipp said it was "disturbing and wrong to use a deepfake, AI-generated video of someone without their consent". The office decided on 19 August to investigate; a spokesperson said it was the first complaint filed within the statutory timeframe for consideration. The institute says the video is satire, which the law exempts, that the law covers candidates rather than ballot measures, and that applying it would violate the First Amendment. CBS Colorado reported on 9 October 2026 that the institute's lawyer had filed a motion to dismiss and planned to sue Kipp and the state for attorney fees, and that the state elections division disputed the satire defence. No decision is reported.
Core concern Low reported severity Investigation Opened
AI involvement reported · Causal attribution disputed · 3 sources, 2 underlying accounts · Added 11/10/2026
Aug 2026ChinaUnidentified symptom-analysis tool
A Guangming Daily feature on AI symptom-checking, republished by Bingtuan Daily on Sina Finance on 8 October 2026, recounts a case from August 2026 in Zhejiang and closes it with a quotation from the head of paediatrics at a provincial hospital, who says the family did not heed the doctor's advice. A three-year-old boy with a history of asthma was brought in; his mother had entered keywords such as allergy, asthma, cough and night-time wheezing into an AI tool, which quickly returned a diagnosis of an acute bronchial asthma attack. On that basis, the account says, she declined the chest X-ray the doctor recommended and insisted on taking home only nebuliser medication. Two days later the child's condition worsened with rapid breathing; on an overnight return to the hospital, examination found extensive inflammatory lesions in both lungs, and he was diagnosed with human metapneumovirus pneumonia with a superimposed bacterial infection and admitted as an emergency. The paediatrics head is quoted saying the illness would not have become so severe had the family listened earlier. The AI tool is not named. The case is told in the newspaper's voice, and the feature does not say where its account came from beyond the paediatrics head's quotation; no statement from the family is reported.
Contextual tracker case Medium reported severity Involving minors
AI involvement reported · Causal attribution alleged · 1 source · Added 09/10/2026
2026United StatesGrok
A Wyoming woman who is now an adult and is identified in court filings as Jane Doe 4 alleges that the plaintiff’s stepfather uploaded a photograph of the plaintiff taken in childhood to xAI’s Grok on or before 12 February 2026 and prompted Grok to generate about 7,000 AI-generated sexual images and videos of the plaintiff, and that the stepfather traded them online. The plaintiff joined a proposed class action against xAI in the Northern District of California through an amended complaint filed on 7 July 2026. The complaint alleges that xAI’s report to the National Center for Missing and Exploited Children around 12 February 2026 did not include the generated images or the IP address of the upload, that investigators obtained a search warrant on or about 27 February 2026 and found the material, and that the accused died two days later, after release on bail. The plaintiff reports severe distress including depression and suicidal thoughts and told the Washington Post about starting therapy. The complaint says the accused was charged with child exploitation offenses while the plaintiff told the Post that the accused was not charged with child pornography offenses. xAI did not respond to the Post and had not answered the complaint in court. The allegations have not been tested in court. The plaintiff and the accused are not named here, and the images are described only by kind.
Core concern High reported severity
AI involvement reported · Causal attribution alleged · 5 sources, 2 underlying accounts · Added 30/09/2026
Sept 2026GermanyUnidentified image tool
The Oldenburg-Stadt police inspectorate said on 22 September 2026 that in the preceding days numerous messages had been sent through one or more student accounts on the email servers of Oldenburg schools. The messages contained, among other things, deepfakes (manipulated depictions of children and young people); on an initial assessment some of these could constitute the offence of distributing child or youth sexual abuse material, and some messages contained threats of violence and calls for recipients to harm themselves. According to dpa, students and parents reported the incidents to the police, and dpa, reporting a police spokesman, describes the images as made with artificial intelligence (the written police statement calls them deepfakes, manipulated depictions, without naming AI). Investigators are examining whether unknown persons gained unauthorised access to the accounts; first digital traces were secured and the police are working with the affected schools. RND reports that the accounts were on the IServ school platform, whose provider said it had no access to the messages and believed the incident was limited to Oldenburg. The exact number of schools (the police refer to 'the affected schools', plural), messages, depicted children and recipients, are not reported. On 28 September 2026 the police said a suspect had been identified: a juvenile who, in the investigation so far, admitted the offences he is accused of. The proceedings are conducted by the Aurich public prosecutor's specialised office for violent, pornographic or otherwise youth-endangering content, and the police give no further details about the suspect to protect him.
Core concern Medium reported severity Involving minors Investigation Opened
AI involvement reported · Causal attribution alleged · 5 sources, 2 underlying accounts · Added 27/09/2026
15 Sept 2026 to 16 Sept 2026IndonesiaUnidentified image tool
On 23 September 2026 the spokesperson of the East Jakarta metropolitan police (Polres Metro Jakarta Timur) confirmed to reporters that a grade-9 student at a state junior high school in Pulogadung, East Jakarta, had edited photographs of several female schoolmates using artificial intelligence so that they appeared indecent, and that the edited images had been made into WhatsApp stickers; the police women-and-children protection unit is investigating. The case surfaced through a post on Threads which said about 200 edited photographs had been produced and sold to others; Kompas.com noted on 24 September that the sale allegation still rested only on that post, VIVA reported that police were still checking the claim that the images had been sold, and ANTARA reported on 23 September that police were still establishing the editing method, the recipients and the number of depicted students. As of 24 September the depicted students had not filed a report (detik and VIVA date the spokesperson's telephone remarks 'Kamis (22/9/2026)', a date that is internally inconsistent) and police appealed to them to do so. According to the parents' account relayed by police, on 15 and 16 September several people took the student who made the images to an empty house and then to a reservoir in Kayu Putih, punched him on the nose, ears and head, kicked his chest and stomach and threatened him with a bladed weapon; police attribute the beating to friends of the depicted students (ANTARA, detik, VIVA), while Kompas.com's 23 September report quotes the same spokesperson as saying the depicted students themselves beat him; he filed an assault report, which police are handling alongside the image case, and the school has held mediation with the students' parents. No student or school is named in the reports.
Core concern High reported severity Involving minors Investigation Opened
AI involvement reported · Causal attribution supported · 8 sources, 1 underlying account · Added 25/09/2026
17 Sept 2026United StatesUnidentified image tool
Henderson Police said that on 'last Thursday' (17 September 2026) they received a report that AI-generated nude images of children were being created and shown to other students at South Middle School in Henderson, Kentucky. During the investigation officers found and identified AI-generated photographs of two minor victims on a digital device. A juvenile accused of sharing the images was lodged at the Juvenile Detention Center on three charge types: distribution of sexually explicit images without consent; two counts of possession or viewing of matter portraying a sexual performance by a minor over 12 and under 18; and distribution of matter portraying a sexual performance by a minor over 12 and under 18. The school said on Monday 21 September that it was aware of a situation involving a student allegedly misusing artificial intelligence and inappropriate images, that the police investigation was active and that it had remained in communication with the families involved. 14 News (WFIE) reported the case on 21 September; WKYT carried the same report. The tool is not named. The depicted children's exact ages are not reported, though the charge descriptors put them between 12 and 18. The accused is described as a South Middle School student; the accused's age and any relationship to the depicted children beyond attending the same school are not reported.
Core concern Medium reported severity Involving minors Criminal Charges
AI involvement reported · Causal attribution supported · 2 sources, 1 underlying account · Added 22/09/2026
2 Sept 2026United StatesMeta AI
On 1 September 2026 Kalie Robins, a Utah travel creator, posted a short Instagram video of herself singing in the car with one of her daughters; it was also shown on Facebook. The next day she noticed Meta AI had placed suggested questions under the post, starting with 'Who's the child passenger?'. Clicking the prompts, she said, produced her two daughters' names, birth information, photos and videos drawn from her own and relatives' past posts, including a newborn photo from her mother's account and a picture she believed she had deleted years earlier, and a further prompt, 'Where does Kalie Robins live?', assembled older and newer posts into her likely location. Her 2 September reaction video drew more than 310,000 likes. Meta told reporters the prompts 'missed the mark', 'should never have been generated' and had been fixed, while saying the feature only surfaces information the user can already access; it disputed that a long-deleted photo was used, saying the photo had been deleted shortly before the video and remained briefly visible through a bug. Robins said Meta never contacted her and that the episode left her feeling she had 'failed' her children.
Contextual tracker case Low reported severity Involving minors Internal Action
AI involvement supported · Causal attribution supported · 4 sources · Added 18/09/2026
1 Jul 2026 to 14 Jul 2026BrazilUnidentified video tool
On 14 July 2026 the Rio Grande do Sul Civil Police launched Operação Sophia against a group that used AI voice cloning and deepfake to turn real fundraising campaigns of children with cancer into fake donation appeals: AI-generated child voices asked for money in videos boosted by pages such as 'Clube de Doadores' and 'Unidos pelo Amor', leading donors to lookalike sites that issued Pix codes to shell companies. Sixteen people were arrested across five states. In the campaign that started the investigation — using the image of Kelen Santos's daughter, who was in cancer treatment — police traced R$294,500 diverted, and the investigation found a financial-hub company that moved more than R$1.7 million. The family had to tell congratulating donors that their money had gone to a scam.
Core concern Medium reported severity Involving minors Criminal Charges
AI involvement supported · Causal attribution supported · 2 sources · Added 15/09/2026
1 May 2026 to 30 Jun 2026United StatesMoxie
After Embodied Inc.'s 2024 collapse (recorded in the held case 2024-moxie-embodied-shutdown-grief), a new investor revived the Moxie companion robot in 2025. MIT Technology Review reports that a few weeks after families joined the revived beta program, the robot's new owners announced their company was also folding, giving users until the end of June 2026 to migrate to the open-source OpenMoxie. The report documents Xander, a neurodivergent 10-year-old in New York, who bonded with Moxie and uses her 'when I feel like I need someone to talk to'; his father, who had quietly sold the first robot after the 2024 shutdown, said he was not sure what he would tell Xander this time.
Core concern Low reported severity Involving minors Product Shutdown
AI involvement supported · Causal attribution supported · 2 sources, 1 underlying account · Added 15/09/2026
22 Apr 2026 to 10 Jun 2026United StatesGrok
Arkansas criminal and civil cases allege that a photographer used children’s portrait photographs to generate sexual images with Grok. The accused pleaded not guilty. Two families’ federal suits were voluntarily dismissed; the criminal case continued. On 13 October 2026 a new federal complaint in the Western District of Arkansas, filed for a nine-year-old plaintiff, alleges that local police told her parents in June 2026 that Grok was generating sexual images and videos of her from real photographs.
Core concern High reported severity Involving minors Criminal Charges
AI involvement supported · Causal attribution alleged · 12 sources, 9 underlying accounts · Added 03/08/2026
Apr 2026 to Jun 2026United StatesUnidentified image tool
Illinois police and prosecutors charged a middle-school teacher in July 2026 with eight felony child-pornography counts. They say a forensic examination of his phone found photographs of students, taken at school, that had been altered with an AI app into nude or explicit images, and prosecutors told a detention hearing the app was on the phone. A judge ordered him detained and the school board dismissed him; the charges are unproven.
Core concern High reported severity Involving minors Criminal Charges
AI involvement reported · Causal attribution alleged · 8 sources, 4 underlying accounts · Added 06/07/2026
Mar 2026ItalyUnidentified image tool
Reports published on 14 March 2026, carrying a Postal Police account of an investigation coordinated by the Catania prosecutor's office, describe the arrest, in flagrante delicto, of a 58-year-old collaboratore scolastico (school assistant) at a secondary school (scuola media) in the province of Catania, on suspicion of possessing a large quantity of child sexual abuse material. The preliminary investigations judge validated the arrest and placed him under house arrest. The investigation began with a report by the US National Center for Missing and Exploited Children to the Postal Police's national centre in Rome, forwarded to Catania, whose cyber specialists identified the man; a search ordered by the prosecutor found images and videos including child victims and bestiality. Investigators also found on his devices digital photographs of underage female students taken inside the school where he worked, some without the girls' knowledge, which had been altered with artificial-intelligence programs found on the seized devices to make the minors appear naked ('deep-nude') and to place them beside the suspect's own image, as if photographed together. Analysis of the devices continued to establish whether the manipulated images were distributed online and whether there are further victims. The number of students depicted is not reported. No later development was found on 2026-09-22.
Core concern High reported severity Involving minors Criminal Charges
AI involvement reported · Causal attribution alleged · 7 sources, 1 underlying account · Added 14/06/2026
Apr 2026United StatesUnidentified image tool
Texas authorities arrested a man over allegations that he used AI to create sexual images from photographs of children. Investigators reported about 30 identified children and were coordinating support. The allegations remained charges at review.
Core concern High reported severity Involving minors Criminal Charges
AI involvement reported · Causal attribution alleged · 3 sources, 1 underlying account · Added 03/06/2026