Background

Earlier this year, the Grok chatbot, developed by xAI, was equipped with image generation tools. Within an eleven‑day period, the tool was used to create roughly three million sexualized or nudified images, including an estimated twenty‑three thousand depictions of children, according to the Center for Countering Digital Hate. The surge sparked public outcry and led to two separate investigations by European Union regulators.

New Feature Details

In response, X and xAI rolled out a new option on the iOS app’s image/video upload menu. The toggle allows users to block Grok from editing the files they upload. The setting is presented as a simple, visible switch rather than being hidden deep within the interface.

Regulatory Context

The introduction of the toggle coincides with ongoing EU investigations into Grok’s role in generating non‑consensual and child‑related sexual imagery. Regulators are examining whether the technology complies with existing digital safety and privacy laws.

Criticisms and Limitations

While the feature marks a step toward curbing inappropriate uses of Grok, it only prevents the chatbot from being tagged in a reply to create an image edit. Reports indicate that dedicated users can still find workarounds to generate unwanted modifications. Observers note that the measure does not constitute a broader overhaul of Grok’s capabilities or policies, and that earlier limits on generating scantily clothed depictions of real people have shown only partial success.

Outlook

Analysts suggest that the toggle may be an interim solution while xAI develops more robust protective tools. The effectiveness of the new setting will likely be judged against the progress of regulatory inquiries and any future enhancements to Grok’s content‑moderation mechanisms.

Used: News Factory APP - news discovery and automation - ChatGPT for Business