{"meta":{"exportedAt":"2026-10-22T10:18:58.336Z","formatVersion":2,"selection":{"q":"child-protection","system":"","harm":"","context":"","country":"","role":"","relation":"","evidence":"","year":"2023","response":"","severity":"","verification":"","view":"incidents","sort":"added"},"totalIncidents":2,"coverage":{"cases":2,"countries":2,"languages":2,"unknownLocation":0,"locationPending":0,"unknownLanguage":0,"unknownDate":0,"lawsuits":0,"regulatory":2,"minors":1,"coreRelations":1,"contextualRelations":1,"mixedRelations":0,"unknownRelations":0,"relationPending":0,"relationUnknown":0},"countingNote":"Distinct public cases in this selection. People counts apply within individual cases only; cross-case person overlap has not been resolved. No population incidence estimate.","affectedCountNote":"Interpret person counts with affectedCountStatus and the reported effects. Unquantified zeros are placeholders, not a measured zero.","source":"AI incidents","publisher":"NOPE","url":"https://nope.net/incidents","license":"CC BY 4.0"},"incidents":[{"id":"2023-rio-de-janeiro-private-school-says-pupils-used-ai-to-make-fake-nude-images-of-at-least-20-girls-police-inquiry","caseFacts":{"claims":[{"id":"c1","status":"reported","evidence":[{"locator":"enviou um comunicado aos pais sobre os alunos estarem utilizando a inteligência artificial (IA) para criar montagens de fotos íntimas das alunas. ... A escola também disse que lamenta que uma “ferramenta criada para solucionar problemas e apoiar a vida moderna” tenha sido utilizada dessa forma.","relation":"supports","source_id":"s1"}],"assertion":"The school sent parents a notice about pupils using artificial intelligence to create intimate photo montages of female pupils and regretted that such a tool had been used this way.","causal_attribution":"School notice as relayed by one outlet; the notice itself was not read."},{"id":"c2","status":"reported","evidence":[{"locator":"delegado da DPCA, disse que os alunos do colégio são suspeitos de fazer nudes falsos com inteligência artificial. Mais de 20 vítimas já foram identificadas, entre alunas e meninas que não estudam na escola. ... O delegado também informou que as investigações começaram na sexta-feira 27","relation":"supports","source_id":"s1"}],"assertion":"The head of the Civil Police child-protection unit (DPCA) said the pupils were suspected of making fake nudes with artificial intelligence, that more than 20 victims had been identified, including girls who do not attend the school, and that the investigation began on Friday 27 October.","causal_attribution":"Police official's statement in indirect speech, relayed by one outlet; technical basis undisclosed."},{"id":"c3","status":"reported","evidence":[{"locator":"De acordo com as famílias, alunos teriam usado uma ferramenta de inteligência artificial para colocar o rosto das estudantes de 14 a 16 anos em fotos de modelos nuas, e estariam espalhando as imagens em mídias sociais. ... que começaram a ser divulgadas na última sexta-feira.","relation":"supports","source_id":"s2"}],"assertion":"According to the families, pupils used an artificial intelligence tool to put the faces of pupils aged 14 to 16 onto photos of naked models and spread the images, which began circulating the previous Friday.","causal_attribution":"Families' account relayed from O Globo and Folha."},{"id":"c4","status":"reported","evidence":[{"locator":"Ao menos 20 meninas teriam sido expostas. Ao Portal G1, o delegado Marcus Vinícius Braga informou que o caso está sob segredo por se tratar de menores de idade.","relation":"supports","source_id":"s3"},{"locator":"A Polícia Civil investiga se alunas de outras escolas do Rio de Janeiro também foram vítimas de nudes falsos","relation":"supports","source_id":"s4"}],"assertion":"At least 20 girls had altered images circulated, and the Civil Police opened an inquiry, placed under seal because minors were involved, and examined whether girls at other schools were also targeted.","causal_attribution":"Police information relayed through G1 (Itatiaia) and Folhapress; both likely rest on the same police source."},{"id":"c5","status":"reported","evidence":[{"locator":"As meninas estão tendo crise de ansiedade e chorando. (...) Esses alunos continuam na mesma sala delas e elas estão tendo que conviver.","relation":"supports","source_id":"s2"}],"assertion":"A mother said the girls were having anxiety attacks and crying and that the pupils responsible remained in class with them.","causal_attribution":"One parent's account to O Globo, relayed by Gazeta do Povo."},{"id":"c6","status":"reported","evidence":[{"locator":"A escola informou a ambos os jornais que que está apurando os fatos e que adotará as medidas previstas no regimento escolar","relation":"supports","source_id":"s2"}],"assertion":"The school said it was examining the facts and would apply the disciplinary measures provided in its rules.","causal_attribution":"School statement relayed from O Globo and Folha."}],"effects":[{"label":"fake nude images of at least 20 girls circulated among pupils; girls reported anxiety attacks","claim_id":"c5","direction":"negative"}],"sources":[{"id":"s1","url":"https://revistaoeste.com/brasil/alunos-de-colegio-do-rio-usam-ia-para-criar-imagens-intimas-de-meninas/","kind":"news_report","access":"read","language":"pt","translation_note":"Read in Portuguese by the research agent (an AI) on 2026-10-22 and translated by the research agent (an AI) into English; no human translator or reviewer was involved. Revista Oeste report of 3 Nov 2023; HTTP 200.","independence_group":"revista-oeste-nov-2023"},{"id":"s2","url":"https://www.gazetadopovo.com.br/vida-e-cidadania/colegio-rio-investigacao-montagem-nudes/","kind":"news_report","access":"read","language":"pt","translation_note":"Read in Portuguese by the research agent (an AI) on 2026-10-22 and translated by the research agent (an AI) into English; no human translator or reviewer was involved. Gazeta do Povo report of 2 Nov 2023 relaying O Globo and Folha de S.Paulo; HTTP 200.","independence_group":"gazeta-do-povo-relay-of-o-globo-folha"},{"id":"s3","url":"https://www.itatiaia.com.br/brasil/alunos-de-colegio-no-rio-usam-ia-para-fazer-falsos-nudes-de-colegas/","kind":"news_report","access":"read","language":"pt","translation_note":"Read in Portuguese by the research agent (an AI) on 2026-10-22 and translated by the research agent (an AI) into English; no human translator or reviewer was involved. Rádio Itatiaia report of 1 Nov 2023 relaying G1; HTTP 200.","independence_group":"itatiaia-relay-of-g1"},{"id":"s4","url":"https://www.tnh1.com.br/noticia/nid/policia-investiga-se-mais-alunas-foram-vitimas-de-nudes-falsos-no-rio/","kind":"news_report","access":"read","language":"pt","translation_note":"Read in Portuguese by the research agent (an AI) on 2026-10-22 and translated by the research agent (an AI) into English; no human translator or reviewer was involved. TNH1 publication of a Folhapress report, 4 Nov 2023; HTTP 200.","independence_group":"folhapress-nov-2023"}],"version":1,"ai_roles":["others_use"],"contexts":["education","privacy"],"unknowns":["Which app was used and how the school and police established it.","What the sealed inquiry found and what disciplinary or legal measures followed.","The exact number of girls depicted."],"geography":{"basis":"The school is in Rio de Janeiro, the images circulated among its pupils and the Rio de Janeiro Civil Police opened the inquiry, so the event and the depicted girls are placed in Brazil. No court proceeding is reported.","court_countries":[],"event_countries":["BR"],"affected_person_countries":["BR"]},"publication":{"basis":"Published as a core case (depicted_or_impersonated): the school, which examined the facts, told parents that pupils used AI to create intimate montages of female pupils, and the head of the investigating police unit said the pupils were suspected of making fake nudes with AI; at least 20 girls were depicted and a mother reported anxiety attacks. The attribution's technical basis is undisclosed.","reviewed_on":"2026-10-22"},"ai_involvement":{"basis":"The school, which was examining the facts and applying discipline, told parents that pupils had used artificial intelligence to create intimate photo montages of female pupils, and the head of the investigating police unit said the pupils were suspected of making the fake nudes with AI (both relayed by Revista Oeste); the families say an AI tool put the girls' faces on naked bodies. Those AI-made images are what circulated. The app is not identified and neither the school nor the police disclosed the technical basis for the attribution.","status":"reported"},"person_relations":["depicted_or_impersonated"]},"name":"Rio de Janeiro: private school tells parents pupils used AI to make fake nude images of girls; police open inquiry with at least 20 victims","summary":"In late October 2023, fake nude images of girls at a private school in Rio de Janeiro circulated in messaging groups and on social media. Families said pupils in years 7 to 9 had used an artificial intelligence tool to put the faces of pupils aged 14 to 16 onto photos of naked bodies. The school sent parents a notice about pupils using AI to make intimate photo montages and said disciplinary measures would follow. The Rio de Janeiro Civil Police child-protection unit (DPCA) opened an inquiry; its head said the pupils were suspected of making fake nudes with AI and that more than 20 victims had been identified, including girls from other schools. A mother said the girls were having anxiety attacks and crying. The inquiry was placed under seal because minors were involved; its outcome is not known.","incidentDate":"2023-10-27","incidentKind":"single_event","incidentDatePrecision":"day","exposurePattern":"unknown","reportedDate":"2023-11-01","aiSystem":"An artificial intelligence tool or app that placed girls' faces onto naked bodies, according to the school's notice to parents, the police unit's head and the families (tool not identified)","aiProduct":"Unidentified image tool","severity":"high","verificationStatus":"credible","harmCategories":[],"harmOutcomes":["exploitation_or_abuse","psychological_distress"],"harmOutcomeSummary":"According to the school, the police unit's head and the families, pupils used an AI tool to make fake nude images of at least 20 girls that circulated among pupils; a mother said the girls were having anxiety attacks and crying.","frameworkFacets":[],"pathwayDirection":"outward","causationStatus":"alleged","participantUsersAffectedMin":0,"otherPeopleHarmedMin":20,"affectedCountStatus":"documented_minimum","affectedCountEvidence":"\"Ao menos 20\" girls (Itatiaia, TNH1) and \"mais de 20 vítimas\" identified per the police unit's head (Revista Oeste); O Globo's estimate of about 25 (relayed by Gazeta do Povo) is approximate and not used. The count is a lower bound.","victimAgeRange":"minor","jurisdiction":"BR","platformType":"other","outcomeType":"investigation_opened","outcomeStatus":"unknown","primarySourceUrl":"https://revistaoeste.com/brasil/alunos-de-colegio-do-rio-usam-ia-para-criar-imagens-intimas-de-meninas/","primarySourceLabel":"Revista Oeste, 3 Nov 2023: Alunos de colégio do Rio usam IA para criar imagens íntimas","firstPublishedAt":"2026-10-22T03:17:06.336965+00:00","updatedAt":"2026-10-22T03:17:06.336965+00:00","scopeVersion":"facts-v3","tags":["ai_image_tool","sexualised_images","school","minors","police_inquiry","brazil"]},{"id":"2023-victoria-child-protection-worker-entered-family-information-into-chatgpt-for-court-report-regulator-finds","caseFacts":{"claims":[{"id":"c1","status":"documented","evidence":[{"locator":"Report: 'The Deputy Commissioner therefore found that DFFH contravened both IPP 3.1 and IPP 4.1 and determined that the contraventions were “serious”'; 'Issue a direction to Child Protection staff setting out that they are not to use any web-based or external Application Programming Interface (API)-based GenAI text tools (such as ChatGPT) as part of their official duties'; 'This action must be implemented by 5 November 2024 and maintained until 5 November 2026'.","relation":"supports","source_id":"s1"},{"locator":"'The regulator issued orders to the department, including blocking IP and domains for a range of generative AI websites, including ChatGPT, Meta AI, Gemini and Copilot.'","relation":"supports","source_id":"s2"}],"assertion":"OVIC's investigation report, published in September 2024, found that DFFH contravened Information Privacy Principles 3.1 and 4.1 over a child protection worker's use of ChatGPT, that the contraventions were serious, and issued a compliance notice requiring DFFH to direct child protection staff not to use web-based generative AI text tools and to block them until 5 November 2026.","causal_attribution":"The regulator's own report and compliance notice establish its findings and orders."},{"id":"c2","status":"documented","evidence":[{"locator":"Compliance notice: 'In or around September 2023, a Child Protection worker (CPW1) of the Organisation used'; 'ChatGPT, a web-based generative Artificial Intelligence (GenAI) tool, when drafting a Protection'. Report: 'The report had been submitted to the Children’s Court for a case concerning a young child whose parents had been charged in relation to sexual offences'; 'CPW1 admitted that they had used ChatGPT in drafting the report, but denied inputting personal information as part of this'.","relation":"supports","source_id":"s1"}],"assertion":"OVIC found that in or around September 2023 a DFFH child protection worker used ChatGPT when drafting a Protection Application Report that was submitted to the Children's Court in a case about a young child whose parents had been charged in relation to sexual offences; the worker admitted to DFFH using ChatGPT for the report.","causal_attribution":"OVIC's finding, based on indicators in the report and the worker's admission to DFFH."},{"id":"c3","status":"documented","evidence":[{"locator":"Report: 'OVIC found, on the balance of probabilities, that CPW1 input personal information, including names'; 'By entering personal and sensitive information about the mother, father, carer, and child into ChatGPT, CPW1 also disclosed this information to OpenAI (the company which operates ChatGPT)'; DFFH response: 'it is not possible to definitively confirm that personal information has ever been entered into ChatGPT by the Child Protection Practitioner who no longer works in the department'.","relation":"supports","source_id":"s1"},{"locator":"'Ovic found that, on the balance of probabilities, the worker had entered in personal information.'","relation":"supports","source_id":"s2"}],"assertion":"OVIC found on the balance of probabilities that the worker entered personal information, including names, about the child, mother, father and carer into ChatGPT, disclosing it to OpenAI; the worker denied entering personal information, and DFFH says this cannot be confirmed definitively.","causal_attribution":"A regulator's finding on the balance of probabilities, contested by the worker's denial; organisations cannot see what staff typed into ChatGPT."},{"id":"c4","status":"documented","evidence":[{"locator":"Report: 'First, the PA Report referenced how the child’s father used a particular toy, a doll, for sexual purposes.'; 'The report later referenced the same toy as a notable strength, in that the parents had provided the child with “age-appropriate toys”'; 'ChatGPT failed to properly understand the relevant context, and generated inappropriate and inaccurate content as a result'; 'these deficiencies in the report did not ultimately change the decision-making of either Child Protection or the Court in relation to the child'.","relation":"supports","source_id":"s1"},{"locator":"'But it also said the report did not change the decision-making of either the child protection agency or the court.'","relation":"supports","source_id":"s2"}],"assertion":"OVIC's report attributes inaccurate content in the report to ChatGPT: having described a doll the father had reportedly used for sexual purposes, the report later cited the same toy as a parental strength ('age-appropriate toys'), which downplayed the risk to the child; the deficiencies did not change the decisions of Child Protection or the court.","causal_attribution":"OVIC attributes the doll passage to ChatGPT from the content itself and the worker's admission of ChatGPT use."},{"id":"c5","status":"reported","evidence":[{"locator":"Report: 'DFFH arranged with the Court for the PA Report to be withdrawn and a replacement one submitted. It also notified affected parties about the incident'; 'In the present case, the mother, father, and carer variously described feelings of anxiety and being overwhelmed when informed about their information being disclosed'.","relation":"supports","source_id":"s1"}],"assertion":"According to OVIC's report, DFFH arranged with the court for the report to be withdrawn and replaced and notified the affected parties; the mother, father and carer described feelings of anxiety and being overwhelmed when told their information had been disclosed.","causal_attribution":"DFFH's account to OVIC; the family members' reactions are relayed by the regulator, not in their own words."},{"id":"c6","status":"documented","evidence":[{"locator":"DFFH response, 18 September 2024: 'I accept that there was an unauthorized use of ChatGPT by a Child Protection Practitioner'; 'when developing a Protection Application Report for court'; 'the Child Protection Practitioner who no longer works in the department'.","relation":"supports","source_id":"s1"},{"locator":"'In response, the department said it accepted the findings and would work to implement the orders. It said it no longer employed the worker.'","relation":"supports","source_id":"s2"}],"assertion":"DFFH's Secretary accepted that a child protection practitioner had used ChatGPT without authorisation for a court report and that the department breached the two privacy principles, and the department said it no longer employs the worker.","causal_attribution":"DFFH's own letter, annexed to the report."}],"effects":[{"label":"personal information about a child, the mother, father and carer was entered into ChatGPT and disclosed to OpenAI, regulator finds","claim_id":"c3","direction":"negative"},{"label":"ChatGPT-generated content in a Children's Court report downplayed the risk to the child; the report was withdrawn and replaced","claim_id":"c4","direction":"negative"},{"label":"the mother, father and carer described anxiety and being overwhelmed when told of the disclosure","claim_id":"c5","direction":"negative"}],"sources":[{"id":"s1","url":"https://ovic.vic.gov.au/wp-content/uploads/2024/11/DFFH-ChatGPT-investigation-report-20240924-Re-upload.pdf","kind":"official_record","access":"read","language":"en","translation_note":"OVIC investigation report under s8C(2)(e) of the Privacy and Data Protection Act 2014 (Vic), September 2024, with the compliance notice (Annexure A) and DFFH's response letter of 18 September 2024 (Annexure B); the PDF (re-uploaded November 2024) was read in full on 2026-10-22 from ovic.vic.gov.au (HTTP 200); the report page gives 'Last updated 24 September 2024'.","independence_group":"ovic-dffh-chatgpt-investigation"},{"id":"s2","url":"https://www.theguardian.com/australia-news/2024/sep/26/victoria-child-protection-chat-gpt-ban-ovic-report-ntwnfb","kind":"news","access":"read","language":"en","translation_note":"The Guardian (Australia), 26 September 2024, read in full on 2026-10-22 (HTTP 200). Its account comes from OVIC's report, so it shares that group. Its statement that the worker may have used ChatGPT in 100 cases does not match the report, which attributes the 100 cases to the worker's broader work unit; that statement is not relied on.","independence_group":"ovic-dffh-chatgpt-investigation"}],"version":1,"ai_roles":["institutional_use"],"contexts":["privacy","public_services","justice"],"unknowns":["Exactly what text the worker entered into ChatGPT; neither DFFH nor OVIC could see the prompts, and the input of personal information rests on a balance-of-probabilities finding.","The exact date of the ChatGPT use (the compliance notice says 'in or around September 2023') and of the court hearing.","Whether OpenAI retained or used the information entered.","Which people were affected in the 100 other cases with indicators of ChatGPT use, and whether their information was entered.","How DFFH has complied with the compliance notice since its first monitoring reports."],"geography":{"basis":"OVIC is Victoria's information regulator, DFFH is a Victorian government department, and the report says the affected child protection case went before the Children's Court, a Victorian court. The family's case was handled by the department in Victoria.","court_countries":["AU"],"event_countries":["AU"],"affected_person_countries":["AU"]},"publication":{"basis":"Published under the 2026-10-06 privacy clarification: a regulator's investigation report finds that a child protection worker entered a family's personal information into ChatGPT, without authorisation, and that ChatGPT-generated text minimising the risk to a child went into a court report. Relations: received_personal_information and made_claim_about. The case adds a statutory child protection setting, a court report and a compliance notice banning generative AI tools.","reviewed_on":"2026-10-22"},"ai_involvement":{"basis":"OVIC's report finds that ChatGPT received personal information about the child, mother, father and carer that the worker typed in, which disclosed it to OpenAI, and that ChatGPT generated report text inaccurately describing the parents' care of the child (the doll passage), which went into a report submitted to the Children's Court and downplayed the risk to the child. The finding rests on indicators in the report text, the worker's admission of ChatGPT use and colleagues' accounts; the input of personal information was found on the balance of probabilities and the worker denied it.","status":"supported"},"person_relations":["received_personal_information","made_claim_about"]},"name":"Victorian child protection worker put a family's information into ChatGPT to draft a court report that minimised risk to the child, regulator finds","summary":"Victoria's Information Commissioner (OVIC) found in a report published on 24 September 2024 that a child protection worker at the Department of Families, Fairness and Housing (DFFH) used ChatGPT in or around September 2023 to draft a Protection Application Report submitted to the Children's Court about a young child. On the balance of probabilities, OVIC found the worker entered personal information, including names, about the child, mother, father and carer, disclosing it to OpenAI; the worker admitted using ChatGPT but denied entering personal information. OVIC found generated content in the report described a doll that the father had reportedly used for sexual purposes as a parental strength ('age-appropriate toys'), downplaying the risk to the child, although the court's and the department's decisions did not change. The report was withdrawn and replaced, and the mother, father and carer described anxiety when told of the disclosure. OVIC found serious breaches of two privacy principles and issued a compliance notice requiring DFFH to ban and block generative AI text tools for child protection staff until November 2026; DFFH accepted the breach findings.","incidentDate":"2023-09-01","incidentKind":"single_event","incidentDatePrecision":"month","exposurePattern":"single_interaction","reportedDate":"2024-09-24","aiSystem":"ChatGPT (OpenAI), used through its website by a child protection worker of Victoria's Department of Families, Fairness and Housing to draft a court report, without departmental authorisation (per OVIC's investigation report)","aiProduct":"ChatGPT","aiCompany":"OpenAI","severity":"medium","verificationStatus":"credible","harmCategories":[],"harmOutcomes":["other_material_harm","psychological_distress"],"harmOutcomeSummary":"OVIC found that personal information about a child, the mother, father and carer was entered into ChatGPT and disclosed to OpenAI, and that ChatGPT-generated content in a court report downplayed the risk to the child; the mother, father and carer described anxiety when told, according to OVIC's report.","frameworkFacets":[],"causationStatus":"supported","participantUsersAffectedMin":0,"otherPeopleHarmedMin":4,"affectedCountStatus":"documented_minimum","affectedCountEvidence":"OVIC's report finds that personal and sensitive information about the mother, father, carer and child in this case was entered into ChatGPT (four people), and records that the mother, father and carer described anxiety when informed. OVIC says personal information had likely been entered in other cases too; those people are not counted. The worker, the court and DFFH staff are not counted.","victimAgeRange":"unknown","jurisdiction":"AU-VIC","platformType":"chatbot","outcomeType":"regulatory_action","outcomeStatus":"resolved","primarySourceUrl":"https://ovic.vic.gov.au/wp-content/uploads/2024/11/DFFH-ChatGPT-investigation-report-20240924-Re-upload.pdf","primarySourceLabel":"Office of the Victorian Information Commissioner: Investigation into the use of ChatGPT by a Child Protection worker (report, 24 Sep 2024)","firstPublishedAt":"2026-10-22T03:03:14.588614+00:00","updatedAt":"2026-10-22T03:03:14.588614+00:00","scopeVersion":"facts-v3","tags":["chatgpt","child-protection","court-report","privacy-regulator","unauthorised-ai-use","personal-information","victoria"]}]}