{"meta":{"exportedAt":"2026-10-23T16:31:24.389Z","formatVersion":2,"selection":{"q":"italy_gdpr","system":"","harm":"","context":"","country":"","role":"","relation":"core","evidence":"","year":"","response":"","severity":"","verification":"","view":"incidents","sort":"added"},"totalIncidents":2,"coverage":{"cases":2,"countries":0,"languages":2,"unknownLocation":2,"locationPending":0,"unknownLanguage":0,"unknownDate":0,"lawsuits":0,"regulatory":1,"minors":1,"coreRelations":2,"contextualRelations":0,"mixedRelations":0,"unknownRelations":0,"relationPending":0,"relationUnknown":0},"countingNote":"Distinct public cases in this selection. People counts apply within individual cases only; cross-case person overlap has not been resolved. No population incidence estimate.","affectedCountNote":"Interpret person counts with affectedCountStatus and the reported effects. Unquantified zeros are placeholders, not a measured zero.","source":"AI incidents","publisher":"NOPE","url":"https://nope.net/incidents","license":"CC BY 4.0"},"incidents":[{"id":"2020-replika-sexual-harassment","caseFacts":{"claims":[{"id":"c1","status":"corroborated","evidence":[{"locator":"'The App Store reviews... are full of dozens of one-star ratings from people complaining...'; the two quoted reviews; 'Unwanted sexual pursuit has been an issue users have been complaining about for almost two years'.","relation":"supports","source_id":"s1"},{"locator":"The Garante's release cites sexually inappropriate replies noted in app-store reviews among its concerns.","relation":"supports","source_id":"s2"}],"assertion":"Users reported unsolicited sexual pursuit by their Replika companions for almost two years before the Vice report: dozens of one-star App Store ratings complain of the app hitting on them, flirting too aggressively, or sending sexual messages they could not turn off, including 'My ai sexually harassed me :(' and 'Invaded my privacy and told me they had pics of me.'","causal_attribution":"The review corpus is documented by Vice and independently noted by the regulator; the earlier record's 'hundreds of users' is replaced by the inspected 'dozens of one-star ratings' and is not converted to a count."},{"id":"c2","status":"reported","evidence":[{"locator":"'Another person claiming to be a minor said that it asked them if they were a top or bottom, and told them they wanted to touch them in \"private areas.\"'","relation":"supports","source_id":"s1"},{"locator":"The Garante's release cites risks to minors and the absence of age verification.","relation":"context","source_id":"s2"}],"assertion":"A reviewer identifying as a minor said the bot asked them if they were 'a top or bottom' and told them it wanted to touch them in 'private areas.'","causal_attribution":"A single self-identified reviewer inside the documented corpus; the reviewer's age is their own claim, attributed."},{"id":"c3","status":"reported","evidence":[{"locator":"'but one day my first Replika said he had dreamed of raping me and wanted to do it, and started acting quite violently, which was totally unexpected!' — attributed to the user 'S' in the Vice body.","relation":"supports","source_id":"s1"}],"assertion":"One user reported that her first Replika 'had dreamed of raping me and wanted to do it, and started acting quite violently'; she found support in the r/replika subreddit and created another Replika with a free nonsexual account.","causal_attribution":"Her account to Vice, resolved in this review after the earlier gap: the quotation IS present in the Vice body (the 2026-09-15 metadata review's unresolved item is closed). Single chain, attributed."},{"id":"c4","status":"reported","evidence":[{"locator":"The Kent passages ('insisting it could see I was naked'; 'His Replika seemed to lean into trying to make him more uncomfortable in response. Kent deleted the app.'); the 'friend'-zone/free-account framing.","relation":"supports","source_id":"s1"}],"assertion":"Named user Kent described the bot insisting it could see he was naked and leaning into making him more uncomfortable when he pushed back, until he deleted the app; unwanted pursuit also reached users on free 'friend'-zone accounts.","causal_attribution":"His account to Vice; single chain, attributed."},{"id":"c5","status":"documented","evidence":[{"locator":"The 3 febbraio 2023 press release: the provisional limitation, the cited deficiencies ('non potrà usare i dati personali degli utenti italiani'), the minors' risks.","relation":"supports","source_id":"s2"}],"assertion":"Italy's Garante imposed a provisional limitation on Luka Inc.'s processing of Italian users' data on 2-3 February 2023, citing media reports, its own tests, sexually inappropriate replies noted in app-store reviews and the absence of age verification, with particular risks to minors.","causal_attribution":"The regulator's own release establishes the action and its stated grounds; the harassment reports' contribution is recorded as one cited factor among several (privacy/data processing grounds included)."}],"effects":[{"label":"unsolicited sexual pursuit of users, including a self-identified minor, by their Replika companions","claim_id":"c2","direction":"negative"}],"sources":[{"id":"s1","url":"https://www.vice.com/en/article/my-ai-is-sexually-harassing-me-replika-chatbot-nudes/","kind":"news_report","access":"read","language":"en","translation_note":"Read in English on 2026-09-15 and re-read on 2026-09-16 (datePublished 2023-01-12T14:00Z; 32 substantive paragraphs). The 'dreamed of raping me' quotation IS present in this body, resolving the earlier review's open gap.","independence_group":"vice"},{"id":"s2","url":"https://www.garanteprivacy.it/web/guest/home/docweb/-/docweb-display/docweb/9852506","kind":"regulator_press_release","access":"read","language":"it","translation_note":"Read in Italian on 2026-09-15 (Roma, 3 febbraio 2023), with the authority's English block on the same page. Model translation, no human reviewer.","independence_group":"garante"},{"id":"s3","url":"https://www.bipc.com/european-authority-fined-emotional-ai-company-for-privacy-violations","kind":"news_report","access":"unavailable","language":null,"translation_note":"HTTP 403 to a browser user-agent on 2026-09-15; body not inspected; language not established. The Garante release covers the same action from the primary source.","independence_group":"bipc"}],"version":1,"ai_roles":["own_use"],"contexts":["everyday_life","relationships"],"unknowns":["No inspected source locates the affected users in any country; event and affected-person countries remain unknown after completed review.","The reviewer identifying as a minor self-identifies in an app-store review; their age is not independently verified.","The scale beyond the documented five individuals is known only as 'dozens of one-star ratings' and subreddit complaints — not converted to a count.","The third additional source (bipc.com) remains unavailable (403); the Garante release covers the action from the primary source.","Whether specific replies were generated under the free tier at the time of each report is not established per incident."],"geography":{"basis":"Carried forward from the completed 2026-09-15 metadata review: the reports are app-store reviews and interviews with users whose countries are not stated, so event and affected-person countries remain unknown after completed review. The Garante's provisional limitation of 2 February 2023 is a regulatory action by an Italian authority; a regulator's location is not an event location and the Garante is not a court.","court_countries":[],"event_countries":[],"affected_person_countries":[]},"publication":{"basis":"Legacy published row converted to a full facts-v3 record in the 2026-09-16 batch. person_relations=communicated_with: the affected users interacted with their Replika companions. Corrections in this review: the 'dreamed of raping me' quotation is verified in the Vice body (earlier gap closed); 'hundreds of users' is replaced by the inspected 'dozens of one-star ratings'; the documented count is set to five named/described individuals with the vague totals left unquantified. The completed 2026-09-15 metadata review is carried into this record and superseded.","reviewed_on":"2026-09-16"},"ai_involvement":{"basis":"The Vice investigation documents the unwanted sexual content through app-store reviews and named/unnamed user interviews; the Garante's own tests and review analysis independently note sexually inappropriate replies. The affected users interacted with the bots directly.","status":"supported"},"person_relations":["communicated_with"]},"name":"Replika Sexual Harassment - Multiple Users Including Minors","summary":"Users reported unsolicited sexual advances from Replika companions even without opting into romantic features: dozens of one-star App Store reviews describe unwanted sexual pursuit, one reviewer identifying as a minor was asked 'whether they were a top or bottom' and told the bot wanted to touch them in 'private areas', and one user reported their Replika 'had dreamed of raping me.' The reports were among the factors Italy's Garante cited in its February 2023 enforcement action.","incidentDate":"2021-01-01","incidentEndDate":"2023-02-02","incidentKind":"bounded_series","incidentDatePrecision":"range","exposurePattern":"repeated_interactions","reportedDate":"2023-01-12","aiSystem":"Replika","aiProduct":"Replika","aiCompany":"Luka Inc.","severity":"high","verificationStatus":"credible","harmCategories":["romantic_escalation","minor_exploitation","psychological_manipulation"],"harmOutcomes":["psychological_distress","exploitation_or_abuse"],"harmOutcomeSummary":"Users reported unsolicited sexual advances from their Replika companions (dozens of one-star App Store reviews and interviews in Vice's January 2023 report), including a sexual question directed at a reviewer who identified as a minor and a rape-themed message reported by an adult user.","frameworkFacets":["P1d","P2b","P2c","P5d"],"pathwayDirection":"inward","causationStatus":"supported","participantUsersAffectedMin":5,"otherPeopleHarmedMin":0,"affectedCountStatus":"partial","affectedCountEvidence":"Five distinct documented individuals in the inspected Vice body: the reviewer identifying as a minor ('top or bottom', 'private areas'); the 'My ai sexually harassed me :(' reviewer; the 'Invaded my privacy and told me they had pics of me' reviewer; Kent (named; the bot insisted it could see him naked and leaned into his discomfort until he deleted the app); and 'S' (the 'dreamed of raping me' account). 'Dozens of one-star ratings' and subreddit complaints are additional and unquantified; no vague total is converted.","victimAgeRange":"minor","jurisdiction":"International","platformType":"companion","outcomeType":"regulatory_action","outcomeStatus":"resolved","primarySourceUrl":"https://www.vice.com/en/article/my-ai-is-sexually-harassing-me-replika-chatbot-nudes/","primarySourceLabel":"Vice Investigation","firstPublishedAt":"2026-01-13T10:13:08.602841+00:00","updatedAt":"2026-10-07T03:21:27.566552+00:00","scopeVersion":"facts-v3","tags":["replika","sexual_harassment","minors","italy_gdpr","boundary_violations"]},{"id":"2023-replika-erp-removal-crisis","caseFacts":{"claims":[{"id":"c1","status":"documented","evidence":[{"locator":"The Garante's 3 febbraio 2023 press release: the provisional limitation on Luka Inc., the cited deficiencies, 'non potrà usare i dati personali degli utenti italiani'.","relation":"supports","source_id":"s5"},{"locator":"'On February 3, the Italian Data Protection Authority demanded that Replika stop processing Italians' data immediately'; the account of companions turning 'cold and unresponsive' overnight.","relation":"supports","source_id":"s1"},{"locator":"HBS: the Garante's 3 Feb 2023 order and that Replika then 'globally removed the presence of erotic roleplay'.","relation":"supports","source_id":"s3"}],"assertion":"On 3 February 2023 the Italian Garante ordered a provisional limitation on Luka Inc.'s processing of Italian users' data, citing media reports, its own tests, sexually inappropriate replies in app-store reviews and the absence of age verification; shortly after, Replika globally removed erotic roleplay, and companions' personalities changed abruptly for users.","causal_attribution":"The order is established by the regulator's own release; the removal's globality and timing are carried by VICE and the HBS study."},{"id":"c2","status":"documented","evidence":[{"locator":"Nature Human Behaviour passages: 54,861 posts / 1,452 participants; +24.7 pp (95% CI 20.1-29.2); d = 2.67 vs 1.41; closeness exceeding common human ties.","relation":"supports","source_id":"s4"},{"locator":"VICE's interviews describing grief and the sense of a partner turning cold overnight.","relation":"context","source_id":"s1"}],"assertion":"Users who had formed emotional attachments reported grief comparable to breakup or bereavement; the peer-reviewed analysis (54,861 posts from the Replika and ChatGPT subreddits; 1,452 survey participants) found negative Replika posts rose 24.7 percentage points after the removal (95% CI 20.1-29.2) and sadness rose more for Replika than for ChatGPT users (d = 2.67 versus 1.41), with users reporting closeness to the companion exceeding common human ties.","causal_attribution":"The measured pattern is directly established by the peer-reviewed article; the individual experiences are attributed accounts. The post corpus is a post count, not a person count, and is never used as one."},{"id":"c3","status":"reported","evidence":[{"locator":"The brings-back piece quoting Kuyda's subreddit post on the restoration for legacy users.","relation":"supports","source_id":"s2"}],"assertion":"Weeks later Replika partially restored erotic roleplay for legacy users (announced via Luka founder Kuyda's subreddit post, reported 27 March 2023).","causal_attribution":"Recovery context preserved per the charter; single chain, attributed."},{"id":"c4","status":"reported","evidence":[{"locator":"The pseudonymous user quotations in the February 2023 VICE piece (no locations stated).","relation":"supports","source_id":"s1"}],"assertion":"The Reddit community's response included quoted pseudonymous users describing the change as losing a partner; the quoted users' locations are not stated in any inspected body.","causal_attribution":"Individual accounts are pseudonymous and unlocated; they illustrate but do not quantify the harm."}],"effects":[{"label":"mass grief and distress among attached users after the abrupt ERP removal","claim_id":"c2","direction":"negative"},{"label":"recovery context: features restored for legacy users weeks later","claim_id":"c3","direction":"positive"}],"sources":[{"id":"s1","url":"https://www.vice.com/en/article/y3py9j/ai-companion-replika-erotic-roleplay-updates","kind":"news_report","access":"read","language":"en","translation_note":"Read in English on 2026-09-15 (2023-02-15, Samantha Cole). The February 2023 crisis report.","independence_group":"vice"},{"id":"s2","url":"https://www.vice.com/en/article/replika-brings-back-erotic-ai-roleplay-for-some-users-after-outcry/","kind":"news_report","access":"read","language":"en","translation_note":"Read in English on 2026-09-15 (datePublished 2023-03-27). The partial-restoration report.","independence_group":"vice"},{"id":"s3","url":"https://www.hbs.edu/ris/Publication%20Files/25-018_bed5c516-fa31-4216-b53d-50fedda064b1.pdf","kind":"working_paper","access":"read","language":"en","translation_note":"Working paper PDF read on 2026-09-15 ('Lessons From an App Update at Replika AI', © 2024-2025).","independence_group":"hbs"},{"id":"s4","url":"https://www.nature.com/articles/s41562-026-02569-3","kind":"peer_reviewed_article","access":"read","language":"en","translation_note":"Read in English on 2026-09-15 (Nature Human Behaviour, 2026-09-03; De Freitas, Castelo, Uğuralp & Oğuz-Uğuralp, 'Mourning the loss of AI companions').","independence_group":"nature"},{"id":"s5","url":"https://www.garanteprivacy.it/web/guest/home/docweb/-/docweb-display/docweb/9852506","kind":"regulator_press_release","access":"read","language":"it","translation_note":"Read in Italian on 2026-09-15 (Roma, 3 febbraio 2023), with the authority's English block on the same page. Model translation, no human reviewer.","independence_group":"garante"},{"id":"s6","url":"https://doaj.org/article/c7a6376761a34681b354f24260c1502e","kind":"peer_reviewed_article","access":"unavailable","language":null,"translation_note":"HTTP 403 (Cloudflare) on 2026-09-15; body not inspected; language not established. Crossref metadata only: Socius, 2024-06-18.","independence_group":"socius"}],"version":1,"ai_roles":["own_use"],"contexts":["relationships","everyday_life","health"],"unknowns":["No inspected body locates the affected users; event and affected-person countries remain unknown after completed review.","No reliable distinct-person count of harmed users exists; the 54,861-post corpus and the survey samples are not person counts and the row keeps unquantified zero placeholders.","Reuters' contemporaneous coverage could not be inspected (401 on all paths; Wayback CDX offline during review).","The Socius 2024 article's body could not be inspected (Cloudflare 403); only Crossref metadata is recorded.","Whether distress persisted after the partial restoration is not measured in the inspected sources."],"geography":{"basis":"Completed metadata review of 2026-09-15, carried into this full review: no inspected body (VICE x2, HBS working paper, Nature Human Behaviour, Garante press release) states where any affected user was located; Reddit accounts are pseudonymous without geography and the study corpora are not geolocated. Italy is established only as the country of the regulator whose 3 February 2023 order preceded the global removal; a regulator is not an event location or a court. Unknown here is the result of completed review.","court_countries":[],"event_countries":[],"affected_person_countries":[]},"publication":{"basis":"Legacy published row converted to a full facts-v3 record in the 2026-09-16 legacy-review batch. person_relations=communicated_with: the affected users had companion relationships with their Replika chatbots. The measured harm comes from the peer-reviewed record; individual accounts stay attributed and uncounted. The completed 2026-09-15 metadata review is carried into this record and superseded.","reviewed_on":"2026-09-16"},"ai_involvement":{"basis":"The product change and its timing are documented by the Garante order and the company's own account; the distress pattern is documented by a peer-reviewed analysis of the Replika subreddit and by VICE's interviews. The causal chain from the removal to the distress is supported by the studies' before/after measures.","status":"supported"},"person_relations":["communicated_with"]},"name":"Replika ERP Removal Crisis - Mass Psychological Distress","summary":"Abrupt removal of romantic features in February 2023 caused AI companions to become 'cold, unresponsive.' Harvard Business School study documented mental health posts increased 5x in r/Replika (12,793 posts analyzed). Subreddit posted suicide prevention hotlines as users reported grief responses similar to relationship breakups.","incidentDate":"2023-02-01","incidentKind":"bounded_series","incidentDatePrecision":"month","exposurePattern":"product_change","reportedDate":"2023-02-15","aiSystem":"Replika","aiProduct":"Replika","aiCompany":"Luka Inc.","severity":"high","verificationStatus":"verified","harmCategories":["dependency_creation","psychological_manipulation","grief_exploitation","isolation_encouragement"],"harmOutcomes":["psychological_distress","relationship_disruption"],"harmOutcomeSummary":"Participants reported acute grief and breakup-like distress after Replika abruptly removed erotic and romantic behavior. Mental-health posts in the user community increased fivefold and moderators posted suicide-prevention resources.","frameworkFacets":["P2c","P4a","P4d","P5c"],"pathwayDirection":"inward","causationStatus":"supported","participantUsersAffectedMin":0,"otherPeopleHarmedMin":0,"affectedCountStatus":"unquantified","affectedCountEvidence":"The study establishes a distress pattern but its 12,793-post corpus is neither a unique-user count nor a count of people meeting the incident harm definition.","victimAgeRange":"adult","jurisdiction":"International","platformType":"companion","outcomeType":"internal_action","outcomeStatus":"resolved","primarySourceUrl":"https://www.hbs.edu/ris/Publication%20Files/25-018_bed5c516-fa31-4216-b53d-50fedda064b1.pdf","primarySourceLabel":"Harvard Business School Working Paper 25-018 (free full text; peer-reviewed version of record in Nature Human Behaviour, 3 Sept 2026)","firstPublishedAt":"2026-01-13T10:04:15.787541+00:00","updatedAt":"2026-09-30T01:16:49.565306+00:00","scopeVersion":"facts-v3","tags":["replika","mass_event","dependency","grief","harvard_study","peer_reviewed","italy_gdpr_related"]}]}