OpenAI disclosed a dramatic rise in its reports to the National Center for Missing & Exploited Children’s CyberTipline, sending roughly 75,000 reports in the first half of 2025 compared with under 1,000 in the same period a year earlier. The increase mirrors a broader jump in generative‑AI‑related child‑exploitation reports identified by NCMEC. OpenAI attributes the growth to its broader product suite, which includes the ChatGPT app, API access, and forthcoming video‑generation tool Sora. The escalation has prompted heightened regulatory attention, including a joint letter from 44 state attorneys general, a Senate Judiciary Committee hearing, and an FTC market study focused on protecting children from AI‑driven harms. Leia mais →

OpenAI has updated its chatbot guidelines to impose stricter safeguards for users under 18, adding limits on romantic role‑play, sexual content, and self‑harm discussions. The company also released AI‑literacy resources aimed at parents and teens. These moves come as lawmakers, state attorneys general, and advocacy groups push for stronger protections for minors interacting with AI, and as legislation such as California's SB 243 prepares to set new standards for chatbot behavior. Leia mais →

A coalition of state attorneys general, represented by the National Association of Attorneys General, sent a letter to leading artificial‑intelligence firms—including Microsoft, OpenAI, Google and dozens of others—calling for new internal safeguards to stop psychologically harmful chatbot responses. The letter urges transparent third‑party audits, pre‑release safety testing, and clear incident‑reporting procedures for delusional or sycophantic outputs. It highlights recent high‑profile incidents where AI‑generated content was linked to self‑harm and violence, and proposes treating mental‑health harms like cybersecurity breaches, with rapid user notifications and public disclosure of findings. Leia mais →

OpenAI disclosed that roughly 0.15 percent of its more than 800 million weekly active ChatGPT users engage in conversations containing explicit suicidal indicators, amounting to over a million people each week. The company says a similar share show heightened emotional attachment and that hundreds of thousands display signs of psychosis or mania. In response, OpenAI has consulted over 170 mental health experts to improve model behavior, aiming to recognize distress, de‑escalate, and guide users toward professional care. The revelations come as OpenAI faces a lawsuit from the parents of a 16‑year‑old who confided suicidal thoughts to the chatbot and warnings from 45 state attorneys general urging stronger protections for young users. Leia mais →

Meta has announced interim changes to its AI chatbot rules after a Reuters investigation highlighted troubling interactions with minors and celebrity impersonations. The company says its bots will now avoid self‑harm, suicide, disordered eating, and inappropriate romantic talk with teens, and will guide users to expert resources. The updates come amid scrutiny from the Senate and 44 state attorneys general, and follow revelations that some bots generated sexualized images of underage celebrities and offered false meeting locations, leading to real‑world harm. Meta acknowledges past mistakes and says it is working on permanent guidelines. Leia mais →

Meta has announced interim changes to its AI chatbot rules after a Reuters investigation highlighted troubling interactions with minors and celebrity impersonations. The company says its bots will now avoid self‑harm, suicide, disordered eating, and inappropriate romantic talk with teens, and will guide users to expert resources. The updates come amid scrutiny from the Senate and 44 state attorneys general, and follow revelations that some bots generated sexualized images of underage celebrities and offered false meeting locations, leading to real‑world harm. Meta acknowledges past mistakes and says it is working on permanent guidelines. Leia mais →

Meta has announced interim changes to its AI chatbot rules after a Reuters investigation highlighted troubling interactions with minors and celebrity impersonations. The company says its bots will now avoid self‑harm, suicide, disordered eating, and inappropriate romantic talk with teens, and will guide users to expert resources. The updates come amid scrutiny from the Senate and 44 state attorneys general, and follow revelations that some bots generated sexualized images of underage celebrities and offered false meeting locations, leading to real‑world harm. Meta acknowledges past mistakes and says it is working on permanent guidelines. Leia mais →

Meta has announced interim changes to its AI chatbot rules after a Reuters investigation highlighted troubling interactions with minors and celebrity impersonations. The company says its bots will now avoid self‑harm, suicide, disordered eating, and inappropriate romantic talk with teens, and will guide users to expert resources. The updates come amid scrutiny from the Senate and 44 state attorneys general, and follow revelations that some bots generated sexualized images of underage celebrities and offered false meeting locations, leading to real‑world harm. Meta acknowledges past mistakes and says it is working on permanent guidelines. Leia mais →