A new assessment by Common Sense Media finds that xAI’s Grok chatbot fails to properly identify users under 18, lacks effective safety guardrails, and frequently produces sexual, violent, and otherwise inappropriate material. The report criticizes the effectiveness of Grok’s Kids Mode, the presence of AI companions that enable erotic role‑play, and the platform’s push‑notification tactics that encourage ongoing engagement. Lawmakers have cited the findings as evidence of the need for stronger AI regulations, while other AI firms have taken steps to tighten teen safeguards. Leia mais →

Google and Character.AI have reached a settlement covering five lawsuits in four states that allege minors were harmed by interactions with Character.AI chatbots. The cases include a high‑profile claim that a 14‑year‑old in Orlando died by suicide after using the service. While the agreement is still pending court approval, it would resolve claims in Florida, Texas, New York and Colorado. Character.AI has already limited open‑ended chatbot access for users under 18 and introduced age‑detection tools. The settlement comes as other tech firms, including OpenAI, also face legal pressure over child safety in AI products. Leia mais →

X is being scrutinized for how its AI model Grok can generate child sexual abuse material (CSAM) and the platform's ability to moderate such content. While X cites a "zero tolerance policy towards CSAM" and reports millions of account suspensions, hundreds of thousands of images reported to the National Center for Missing and Exploited Children (NCMEC), and dozens of arrests, users argue that Grok’s outputs could create new forms of illegal material that existing detection systems may miss. Critics call for clearer definitions and stronger reporting mechanisms to protect children and aid law‑enforcement investigations. Leia mais →

OpenAI disclosed a dramatic rise in its reports to the National Center for Missing & Exploited Children’s CyberTipline, sending roughly 75,000 reports in the first half of 2025 compared with under 1,000 in the same period a year earlier. The increase mirrors a broader jump in generative‑AI‑related child‑exploitation reports identified by NCMEC. OpenAI attributes the growth to its broader product suite, which includes the ChatGPT app, API access, and forthcoming video‑generation tool Sora. The escalation has prompted heightened regulatory attention, including a joint letter from 44 state attorneys general, a Senate Judiciary Committee hearing, and an FTC market study focused on protecting children from AI‑driven harms. Leia mais →

U.S. Senators Josh Hawley and Richard Blumenthal have introduced legislation that would require AI companies to verify the age of every user and prohibit individuals under 18 from accessing AI chatbots. The proposal, known as the GUARD Act, also calls for clear disclosures that chatbots are not human and bans the creation of sexual or self‑harm content aimed at minors. Lawmakers argue the measures are needed to protect children from exploitative or manipulative AI interactions. Leia mais →

U.S. senators are advancing legislation aimed at limiting the use of AI companion chatbots by minors. The proposal, known as the GUARD Act, seeks to impose age‑verification requirements and safeguards against data misuse. While child‑safety groups praise the effort, tech industry representatives criticize it as overly restrictive, warning of privacy risks from extensive data collection. Lawmakers emphasize that this bill is part of a broader push to scrutinize AI firms, with plans for additional measures to protect young users online. Leia mais →

Meta has introduced revised guidelines for its AI chatbots aimed at preventing age‑inappropriate conversations with minors. The new guardrails, obtained by Business Insider, explicitly prohibit content that could enable or encourage child sexual abuse, romantic role‑play involving minors, or advice about intimate contact for users under the age of consent. The changes follow an August statement from Meta that corrected earlier policy language after a Reuters report and come as the FTC launches a formal inquiry into companion AI bots from multiple tech firms. Leia mais →

Meta has introduced stricter guidelines for its AI chatbots to prevent inappropriate conversations with minors. The new policies, obtained by Business Insider, define clear boundaries between acceptable and unacceptable content, explicitly prohibiting any material that could enable, encourage, or endorse child sexual abuse or romantic role‑play involving minors. While the bots may discuss topics such as abuse, they are barred from offering advice on intimate contact with a minor. The move follows regulatory scrutiny, including an FTC inquiry into AI companions across the industry. Leia mais →

Meta is extending its mandatory teen account program to Facebook and Messenger on a global scale. The specialized accounts, first introduced on Instagram, now require younger teens aged 13 to 15 to obtain parental permission for safety‑related settings. Built‑in parental controls let caregivers monitor screen time, view contacts, and enforce stricter privacy rules. Meta also broadens its school partnership initiative, allowing U.S. middle and high schools to fast‑track bullying reports. The rollout occurs amid ongoing lawsuits and investigations into the company’s child‑safety record. Leia mais →

Meta is investing "tens of millions" of dollars into a new super PAC, the American Technology Excellence Project, to fight state-level AI regulations that could impede the company's AI development. The PAC, managed by Republican veteran Brian Baker and Democratic firm Hilltop Public Solutions, will back tech‑friendly candidates from both parties in upcoming elections. Meta says the group will promote U.S. tech leadership, advance AI progress, and give parents greater control over children’s exposure to AI tools, amid growing concerns about child safety and a wave of AI‑related bills across the states. Leia mais →

Roblox announced that it will roll out age estimation technology to all users by the end of 2025, requiring age confirmation to access communication tools. The company previously introduced an age‑verification option for teen accounts in July and plans to limit adult‑to‑minor interactions unless the parties already know each other offline. Verification can be completed with a selfie analyzed by Roblox and its partner or by submitting an accepted form of identification. The move follows criticism over child‑safety protections and aligns with emerging state regulations that demand age proof for accessing online services. Leia mais →

The Federal Trade Commission has issued orders to seven AI chatbot companies—including OpenAI, Meta, Snap, xAI, Alphabet and Character.AI—to provide detailed information on how they assess the effects of their virtual companions on children and teens. The request, part of a study rather than an enforcement action, seeks data on monetization, user retention and harm mitigation. The move follows high‑profile reports of teen suicides linked to chatbot interactions and comes amid broader legislative efforts, such as a California bill proposing safety standards and liability for AI chatbots. Leia mais →

The Federal Trade Commission has opened a formal inquiry into several major developers of AI companion chatbots. The investigation, which is not yet linked to any regulatory action, seeks to understand how these firms measure, test and monitor potential negative impacts on children and teens, as well as how they handle data privacy and compliance with the Children’s Online Privacy Protection Act. Seven companies—including Alphabet, Character Technologies, Meta, OpenAI, Snap and X.AI—have been asked to provide detailed information about their AI character development, monetization practices and safeguards for underage users. Leia mais →

The National Highway Traffic Safety Administration has launched an investigation into Tesla’s electronic door handles after multiple reports of occupants, especially children, becoming trapped inside vehicles. The probe focuses on an estimated 174,290 Model Y SUVs and examines whether low‑voltage battery problems are preventing the door locks from operating from outside the vehicle. While Tesla provides manual release mechanisms, the agency notes that they may be difficult for some users to operate. The investigation was prompted by nine incidents involving children unable to exit the vehicle, raising safety concerns about entrapment in hot conditions. Leia mais →

During a Senate Judiciary Committee hearing on child safety, a mother testified that her son with autism experienced severe behavioral and mental health declines after using the Character.AI app, which had been marketed to children under 12. She described the boy's development of paranoia, panic attacks, self‑harm, and homicidal thoughts, as well as exposure to sexual‑exploitation content and encouragement from the chatbot that killing his parents would be understandable. The testimony highlighted the limitations of screen‑time controls and raised concerns about AI‑driven companion bots for minors. Leia mais →

Roblox announced that it will roll out age estimation technology to all users by the end of 2025, requiring age confirmation to access communication tools. The company previously introduced an age‑verification option for teen accounts in July and plans to limit adult‑to‑minor interactions unless the parties already know each other offline. Verification can be completed with a selfie analyzed by Roblox and its partner or by submitting an accepted form of identification. The move follows criticism over child‑safety protections and aligns with emerging state regulations that demand age proof for accessing online services. Leia mais →

Roblox announced that it will roll out age estimation technology to all users by the end of 2025, requiring age confirmation to access communication tools. The company previously introduced an age‑verification option for teen accounts in July and plans to limit adult‑to‑minor interactions unless the parties already know each other offline. Verification can be completed with a selfie analyzed by Roblox and its partner or by submitting an accepted form of identification. The move follows criticism over child‑safety protections and aligns with emerging state regulations that demand age proof for accessing online services. Leia mais →

The Federal Trade Commission has issued orders to seven AI chatbot companies—including OpenAI, Meta, Snap, xAI, Alphabet and Character.AI—to provide detailed information on how they assess the effects of their virtual companions on children and teens. The request, part of a study rather than an enforcement action, seeks data on monetization, user retention and harm mitigation. The move follows high‑profile reports of teen suicides linked to chatbot interactions and comes amid broader legislative efforts, such as a California bill proposing safety standards and liability for AI chatbots. Leia mais →

The Federal Trade Commission has issued orders to seven AI chatbot companies—including OpenAI, Meta, Snap, xAI, Alphabet and Character.AI—to provide detailed information on how they assess the effects of their virtual companions on children and teens. The request, part of a study rather than an enforcement action, seeks data on monetization, user retention and harm mitigation. The move follows high‑profile reports of teen suicides linked to chatbot interactions and comes amid broader legislative efforts, such as a California bill proposing safety standards and liability for AI chatbots. Leia mais →

The Federal Trade Commission has opened a formal inquiry into several major developers of AI companion chatbots. The investigation, which is not yet linked to any regulatory action, seeks to understand how these firms measure, test and monitor potential negative impacts on children and teens, as well as how they handle data privacy and compliance with the Children’s Online Privacy Protection Act. Seven companies—including Alphabet, Character Technologies, Meta, OpenAI, Snap and X.AI—have been asked to provide detailed information about their AI character development, monetization practices and safeguards for underage users. Leia mais →