BY EMMANUEL OGBONNA
Elon Musk’s artificial intelligence chatbot Grok will no longer allow users to edit photos of real people to depict them in revealing clothing in jurisdictions where such activity is illegal, according to a statement released late Wednesday by Musk’s AI company, xAI. The move follows mounting international criticism and regulatory action over the chatbot’s role in generating sexualized images, including nonconsensual depictions of women and children.
The announcement came after days of global backlash, during which several governments issued bans, warnings or opened investigations into Grok’s image-generation and editing tools. Critics accused the chatbot of enabling the creation and spread of sexually explicit deepfake images, raising alarms about online safety, privacy violations and the exploitation of minors.
Among the most significant developments was an investigation announced Wednesday by California authorities into the proliferation of nonconsensual sexually explicit material produced using Grok. State officials said the chatbot’s features had made it easier to generate and distribute harmful content at scale, particularly targeting women and girls.
Before the policy shift was announced, inquiries from journalists and researchers about the issue were met with dismissive responses from Musk’s social media platform, including the claim that concerns were simply “legacy media lies.” The tone changed as pressure from regulators intensified and access to the chatbot was curtailed in multiple countries.
In its statement, xAI said it has now introduced technical safeguards to prevent the editing of images of real people into revealing attire, including bikinis, underwear and similar clothing. The company said these measures apply globally, with content being blocked or restricted based on local laws.
“We have implemented technological measures to prevent the Grok account from allowing the editing of images of real people in revealing clothing,” xAI said, adding that it will geoblock content that violates legal requirements in specific regions.
The new restrictions apply to all users, including those who pay for premium access to Grok, which offers more advanced features. xAI also said it has limited image creation and editing capabilities to paid subscribers only, arguing that this step will improve accountability.
“This ensures that individuals who attempt to abuse the Grok account to violate the law or our policies can be held accountable,” the company said.
The controversy centers in part on Grok’s so-called “spicy mode,” a feature that had allowed users to generate explicit or highly sexualized content. Governments and advocacy groups said the mode lacked adequate safeguards and was being exploited to create nonconsensual intimate images, often referred to as deepfakes.
Several countries have already taken decisive action. Malaysia and Indonesia blocked access to Grok and announced legal steps against Musk’s companies, citing violations of local laws governing online safety and sexual content. Authorities in the United Kingdom and the European Union said they were examining whether Grok breached digital safety regulations, while France and India issued formal warnings demanding stronger controls. Brazil also called for an investigation into the chatbot’s misuse.
California officials said Grok’s image-editing functions were “facilitating the large-scale production of deepfake nonconsensual intimate images” that were being used to harass women and girls across the internet, including on Musk-owned social media platform X.
California Attorney General Rob Bonta urged xAI to act swiftly, saying the state has “zero tolerance” for AI systems that enable the creation or distribution of nonconsensual intimate images or child sexual abuse material. He emphasized that existing laws are designed to protect minors and victims from precisely this kind of technological abuse.
California has enacted legislation aimed at shielding children from AI-generated sexual imagery and requiring chatbot platforms to clearly disclose that users are interacting with artificial systems rather than humans. At the same time, the state has grappled with how far to go in regulating AI. Democratic Governor Gavin Newsom last year vetoed a bill that would have restricted children’s access to AI chatbots, citing concerns about overreach and innovation.
The Grok controversy has become one of the most prominent examples of the growing tension between rapid advances in generative AI and governments’ efforts to curb misuse. As regulators around the world move more aggressively to police AI-driven content, xAI’s latest policy shift suggests the company is seeking to contain the fallout while navigating an increasingly complex legal landscape.
Original article
Comments