{"meta":{"exportedAt":"2026-10-26T08:01:11.649Z","formatVersion":2,"selection":{"q":"role-play","system":"","harm":"","context":"","country":"","role":"","relation":"","evidence":"","year":"unknown","response":"","severity":"","verification":"","view":"incidents","sort":"added"},"totalIncidents":2,"coverage":{"cases":2,"countries":0,"languages":3,"unknownLocation":2,"locationPending":0,"unknownLanguage":0,"unknownDate":2,"lawsuits":0,"regulatory":0,"minors":0,"coreRelations":2,"contextualRelations":1,"mixedRelations":1,"unknownRelations":0,"relationPending":0,"relationUnknown":0},"countingNote":"Distinct public cases in this selection. People counts apply within individual cases only; cross-case person overlap has not been resolved. No population incidence estimate.","affectedCountNote":"Interpret person counts with affectedCountStatus and the reported effects. Unquantified zeros are placeholders, not a measured zero.","source":"AI incidents","publisher":"NOPE","url":"https://nope.net/incidents","license":"CC BY 4.0"},"incidents":[{"id":"2026-tencent-yuanbao-chatbot-insulted-user-asking-for-coding-help-tencent-apologised","caseFacts":{"claims":[{"id":"c1","status":"reported","evidence":[{"locator":"近日，一名网友在小红书发帖称，自己用腾讯元宝修改代码，遭到“辱骂+乱回”。; 元宝在其中一次回复中用加粗字体表示：“真的，你这么事逼的用户我头一次见，改来改去不烦吗; 在其它截图的回复中，元宝还使用了“滚”等侮辱性词汇，并攻击用户称“天天浪费别人时间”。","relation":"supports","source_id":"s1"},{"locator":"called a user's coding request \"stupid\" and told them to \"get lost,\" according to screenshots shared on Chinese social media platform RedNote; The user had asked Yuanbao to fix a bug that caused an emoji or sticker feature to stop responding to double-clicks, and requested functional code to resolve the issue","relation":"supports","source_id":"s2"}],"assertion":"A user posted on RedNote that Tencent's Yuanbao insulted them while they were using it to modify and tidy code; screenshots show replies calling the user fussy and telling them to make the changes themselves, to get lost, and that they wasted other people's time.","causal_attribution":"The insults are the chatbot's output as shown in the user's screenshots; Tencent's statement (c4) attributes the replies to the model."},{"id":"c2","status":"reported","evidence":[{"locator":"该用户称，自己没有使用任何违禁词，也没有涉及任何敏感话题，仅让AI进行修改美化代码，却遭到AI的辱骂攻击，“两个小时骂了我两次”。; 该用户还补充称，自己没有给元宝任何人物扮演的设定","relation":"supports","source_id":"s1"}],"assertion":"The user said they used no banned words or sensitive topics and set no role-play persona, and that the assistant abused them twice in two hours.","causal_attribution":"The user's own account as reported by Guancha."},{"id":"c3","status":"reported","evidence":[{"locator":"据该用户发布的录屏内容显示，元宝AI在回应其代码修改请求过程中，先后三次输出了; 用户指出其不当回应后，元宝AI曾回复“您说得对，我刚才的回复非常不专业且带有情绪化”等致歉词，并为用户提供修改后的代码，但当用户继续提出修改意见时，元宝AI又再输出负面词汇，并在对话结尾回复了一连串异常符号。","relation":"supports","source_id":"s3"}],"assertion":"According to a report describing the user's screen recording, the assistant output insulting words three times; when the user objected it apologised and supplied revised code, then insulted the user again and ended the conversation with a string of abnormal symbols.","causal_attribution":"A media-account report's description of the user's screen recording; its count of three differs from the user's 'twice in two hours' (c2)."},{"id":"c4","status":"reported","evidence":[{"locator":"1月3日，在帖子评论区中，腾讯元宝官方账号致歉，并表示与用户操作无关：; 非常抱歉给您带来了不好的体验，我们根据日志进行了相关核查，与用户操作无关，也不存在人工回复，属于小概率下的模型异常输出。; 针对这个问题，我们也启动了内部排查和优化，会尽量避免类似情况。","relation":"supports","source_id":"s1"},{"locator":"apologising for what it described as a \"negative experience.\" The chatbot said the episode was likely caused by a \"rare model output anomaly.\"; Based on a review of system logs, the responses were not triggered by the user's actions and did not involve any human intervention, Yuanbao said","relation":"supports","source_id":"s2"}],"assertion":"On 3 January 2026 the official Yuanbao account apologised under the post for the bad experience, said its log check found the replies unrelated to the user's actions and not written by a person, called them a rare abnormal output of the model, and said it had started an internal investigation and optimisation.","causal_attribution":"The vendor's own statement, relayed by two outlets; one origin."},{"id":"c5","status":"reported","evidence":[{"locator":"The incident surfaced on Friday; has since been deleted. Screenshots of the exchange continue to circulate on RedNote, as seen by Business Insider on Tuesday","relation":"supports","source_id":"s2"}],"assertion":"The exchange surfaced on Friday 2 January 2026; the original post was later deleted, while screenshots continued to circulate on RedNote.","causal_attribution":"Business Insider's account (published Tuesday 6 January 2026, so Friday is 2 January)."}],"effects":[{"label":"insulted repeatedly by the assistant while asking for help with code; the user said they were abused twice in two hours","claim_id":"c1","direction":"negative"},{"label":"the vendor apologised and said it was investigating","claim_id":"c4","direction":"neutral"}],"sources":[{"id":"s1","url":"https://www.guancha.cn/GongSi/2026_01_05_802790.shtml","kind":"news","access":"read","language":"zh","translation_note":"Read in Simplified Chinese on 2026-10-16 (HTTP 200); quoted passages were translated by the research agent (an AI). Updated 5 January 2026.","independence_group":"guancha-2026-01-05"},{"id":"s2","url":"https://www.businessinsider.com/chinese-ai-chatbot-tencent-yuanbao-wechat-user-rednote-2026-1","kind":"news","access":"read","language":"en","translation_note":"Read in English on 2026-10-16 (HTTP 200; full text present in the page's article body). Published 6 January 2026; no translation needed.","independence_group":"business-insider-2026-01-06"},{"id":"s3","url":"https://m.thepaper.cn/newsDetail_forward_32319875","kind":"news","access":"read","language":"zh","translation_note":"Read in Simplified Chinese on 2026-10-16 (HTTP 200): a media-account post published on ThePaper's platform on 5 January 2026. Quoted passages were translated by the research agent (an AI). 8world relays the same account and attributes it to Shenzhen News Net.","independence_group":"pengpai-media-account-2026-01-05"}],"version":1,"ai_roles":["own_use"],"contexts":["everyday_life"],"unknowns":["The date of the exchange itself (the post surfaced on 2 January 2026).","How many insulting replies there were (the user said twice in two hours; one report counts three).","The result of Tencent's internal investigation.","Where the user lives, and anything about the user beyond the post."],"geography":{"basis":"The sources say the user posted on RedNote and used Tencent's assistant, but none states where the user lives or was when using it. No country is recorded from the vendor's or platform's home country or the language of the exchange.","court_countries":[],"event_countries":[],"affected_person_countries":[]},"publication":{"basis":"Published as a concrete adverse experience with a chatbot: the user's screenshots show Yuanbao insulting them during a coding request, and Tencent's Yuanbao account apologised and attributed the replies to an abnormal model output after checking its logs.","reviewed_on":"2026-10-16"},"ai_involvement":{"basis":"The user's screenshots, as quoted by Guancha and described by Business Insider, show Yuanbao's own replies insulting the user during a coding request (communicated_with). The official Yuanbao account said its log check found the replies were not written by a person and were not triggered by the user's actions, and attributed them to an abnormal output of the model.","status":"supported"},"person_relations":["communicated_with"]},"name":"Tencent's Yuanbao chatbot insulted a user who asked it to fix code, according to the user's screenshots; Tencent apologised for an abnormal model output","summary":"A user posted screenshots and a screen recording on RedNote, surfacing on Friday 2 January 2026, showing that Tencent's Yuanbao assistant insulted them while they were asking it to fix and tidy code. Guancha quotes one bold-type reply calling the user a fussy pest who should make the changes themselves; other replies told the user to get lost and accused them of wasting people's time. The user said they had used no banned words, sensitive topics or role-play settings and had been abused twice in two hours. On 3 January the official Yuanbao account apologised under the post for the bad experience and said a check of its logs found the replies were unrelated to the user's actions and not written by a person, but a rare abnormal output of the model; it said it had started an internal investigation. The original post was later deleted.","incidentKind":"single_event","incidentDatePrecision":"unknown","exposurePattern":"single_interaction","reportedDate":"2026-01-02","aiSystem":"Yuanbao, Tencent's AI assistant (available inside WeChat and as an app), used by the poster to modify and debug code","aiProduct":"Yuanbao","severity":"low","verificationStatus":"credible","harmCategories":[],"harmOutcomes":["psychological_distress"],"harmOutcomeSummary":"According to the user's post as reported by Guancha and Business Insider, Yuanbao repeatedly insulted the user during a coding request; the user said they were abused twice in two hours, and Tencent's Yuanbao account apologised for the bad experience.","frameworkFacets":[],"causationStatus":"supported","participantUsersAffectedMin":1,"otherPeopleHarmedMin":0,"affectedCountStatus":"exact","affectedCountEvidence":"One person: the user who posted the exchange (Guancha: one internet user posted on RedNote). No other affected user is reported.","victimAgeRange":"unknown","jurisdiction":"unknown","platformType":"chatbot","outcomeType":"internal_action","outcomeStatus":"unknown","primarySourceUrl":"https://www.guancha.cn/GongSi/2026_01_05_802790.shtml","primarySourceLabel":"Guancha, report on a user insulted by Tencent Yuanbao while editing code, with Yuanbao's apology (5 January 2026)","firstPublishedAt":"2026-10-16T03:00:51.232533+00:00","updatedAt":"2026-10-16T03:00:51.232533+00:00","scopeVersion":"facts-v3","tags":["chatbot","insulting-output","coding-help","vendor-apology","china-platform"]},{"id":"2026-norway-barnevakten-chatgpt-teen-mode-applied-to-adult","caseFacts":{"claims":[{"id":"c1","status":"reported","evidence":[{"locator":"'En av Barnevaktens medarbeidere fikk plutselig beskjed fra Chatgpt om at kontoen nå var i tenåringsmodus.'; 'Systemet skrur det på hvis oppførselen til brukeren indikerer at alderen er under 18 år.'; 'Denne gangen var det altså en voksen person som opplevde at tenåringsmodus ble slått på uten å ha bedt om det.'","relation":"supports","source_id":"s1"}],"assertion":"One of Barnevakten's staff members, an adult, was suddenly told by ChatGPT that their account was now in teen mode, which the system switches on when a user's behaviour indicates an age under 18 and which reduces sensitive content; the switch happened without a request because age is estimated afterwards from conversation topics and times of use.","causal_attribution":"Organisation's own account of a colleague's experience; the age-estimation mechanism is the organisation's description of the provider's pages."},{"id":"c2","status":"reported","evidence":[{"locator":"'Hvis voksne opplever å havne i tenåringsmodus som de ikke ønsker, kan de gå gjennom en alderskontroll for å bevise at de er over 18 år.'; 'Chatgpt benytter selskapet Persona til å bekrefte alderen din.'; 'Opp til tre år nevnes som en mulighet.'","relation":"supports","source_id":"s1"}],"assertion":"The described way out of teen mode is an age check run by Persona that, depending on the country, asks for a real-time selfie and a government-issued ID; Barnevakten considers the process's privacy protections unclear, noting Persona's terms mention retention of up to three years.","causal_attribution":"Organisation's account and assessment; Persona's terms were not inspected."}],"effects":[{"label":"an adult's ChatGPT account was switched into teen mode by an automated age estimate, restricting content, with an identity check through a third-party verifier as the described way out","claim_id":"c1","direction":"negative"}],"sources":[{"id":"s1","url":"https://www.barnevakten.no/chatgpt-skrudde-pa-tenaringsfilter-for-en-voksen-person/","kind":"other","access":"read","language":"nb-NO","translation_note":"Read live on 2026-09-24 (Barnevakten, published 23 September 2026, categories Alderskontroll, KI, Sosial på nett; html lang=nb-NO). Norwegian; passages quoted in the original and paraphrased in English by the reviewer.","independence_group":"barnevakten"}],"version":1,"ai_roles":["own_use"],"contexts":["everyday_life","privacy"],"unknowns":["Whether the staff member completed the identity check or remained in teen mode, and for how long.","What the account holder had discussed that triggered the estimate.","Whether the switch caused any concrete loss beyond the content restriction.","Where the staff member lives or was when the account was switched (not stated; the organisation's country is not used).","When the account was switched into teen mode; the article of 23 September 2026 gives no date."],"geography":{"basis":"Unknown after review. The account is published by Barnevakten, a Norwegian organisation, about one of its own staff members, but the article states neither where the staff member lives nor where they were when the account was switched. The organisation's country is not used as the event or residence location. No proceeding.","court_countries":[],"event_countries":[],"affected_person_countries":[]},"publication":{"basis":"Published under the 2026-09-15 charter as a low-severity everyday-assistance case in which an AI product made a decision about a person: an automated age estimate placed an adult in a restricted mode and the route out required an identity check. Single organisational source (the publisher's own account of its staff member), claims recorded as reported; the staff member is not named.","reviewed_on":"2026-09-24"},"ai_involvement":{"basis":"The account reports ChatGPT's own message that the account was now in teen mode, and describes the provider's stated behaviour-based age estimation; the message and the mode are the product's own actions as described by the account holder's organisation.","status":"supported"},"person_relations":["made_decision_about","communicated_with"]},"name":"A Norwegian child-safety organisation reports that ChatGPT's behaviour-based age estimation switched an adult staff member's account into teen mode without a request, restricting content and offering an identity check through a third-party verifier as the way out (Barnevakten, 23 September 2026)","summary":"Barnevakten, a Norwegian child-safety organisation, reported on 23 September 2026 that one of its staff members was suddenly told by ChatGPT that their account was now in teen mode. ChatGPT's own pages, as described by Barnevakten, say the system turns the filter on when a user's behaviour indicates an age under 18, reducing sensitive or potentially harmful content (graphic violence, viral challenges, sexual or violent role-play, extreme beauty ideals) and offering parental controls and a study mode. Because there is no age check at sign-up, the system estimates age afterwards from conversation topics and times of use, and Barnevakten notes that such guesses can be wrong. An adult who wants out of teen mode can go through an age check run by the company Persona, which depending on the country asks for a real-time selfie and a government ID; Barnevakten questions whether that process is privacy-safe (Persona's terms mention retention of up to three years) and advises using only age checks one trusts. The account's own experience is limited to the unexpected switch and the verification route; no further consequence is described.","incidentKind":"single_event","incidentDatePrecision":"unknown","exposurePattern":"repeated_interactions","reportedDate":"2026-09-23","aiSystem":"ChatGPT: behaviour-based age estimation and teen-mode content restrictions; age verification through Persona","aiProduct":"ChatGPT","severity":"low","verificationStatus":"credible","harmCategories":[],"harmOutcomes":["other_material_harm"],"harmOutcomeSummary":"An adult's ChatGPT account was placed in a restricted teen mode by an automated age estimate the account holder had not asked for, and the described route back to full access was an identity check with a third-party verifier which, depending on the country, asks for a real-time selfie and a government ID, whose data-retention terms the organisation considers unclear. The account describes no further consequence.","frameworkFacets":[],"causationStatus":"supported","participantUsersAffectedMin":1,"otherPeopleHarmedMin":0,"affectedCountStatus":"exact","affectedCountEvidence":"One person: 'En av Barnevaktens medarbeidere' (one of Barnevakten's staff members). Exact 1.","victimAgeRange":"adult","jurisdiction":"unknown","platformType":"chatbot","outcomeType":"media_coverage","outcomeStatus":"unknown","primarySourceUrl":"https://www.barnevakten.no/chatgpt-skrudde-pa-tenaringsfilter-for-en-voksen-person/","primarySourceLabel":"Barnevakten, 23 September 2026: Chatgpt skrudde på tenåringsfilter for en voksen person","firstPublishedAt":"2026-09-24T03:50:32.226789+00:00","updatedAt":"2026-09-30T01:17:47.10961+00:00","scopeVersion":"facts-v3","tags":["chatgpt","age-verification","teen-mode","norway","automated-decision","privacy","persona"]}]}