Following a global backlash and widespread concern over sexualized AI deepfakes, Elon Musk’s xAI confirmed on Wednesday that its chatbot Grok will no longer give people the ability to edit images of real people “in territories where it is illegal.”
The climbdown was released as a statement via X’s Safety account, making it clear that the restrictions apply to paid and unpaid users.
We have implemented technological measures to prevent the Grok account from allowing the editing of images of real people in revealing clothing such as bikinis. This restriction applies to all users, including paid subscribers.
Safety on X statement, 14 January
Additionally, image creation and the ability to edit images via the Grok account on the X platform are now only available to paid subscribers. This adds an extra layer of protection by helping to ensure that individuals who attempt to abuse the Grok account to violate the law or our policies can be held accountable.
We now geoblock the ability of all users to generate images of real people in bikinis, underwear, and similar attire via the Grok account and in Grok in X in those jurisdictions where it’s illegal.
The announcement came hours after California confirmed that it was probing the spread of sexualized AI deepfakes, including those of children, generated by the AI model.
Pressure intensified further last week after Malaysia and Indonesia became the first countries in the world to block access to Grok outright.
Another vocal critic has been the UK government. The use of Grok to generate non-consensual sexualized images has been condemned by Prime Minister Sir Keir Starmer as "disgraceful" and "disgusting."
X was also referred to the UK regulator Ofcom to investigate whether X had breached the Online Safety Act.
The Cybernews community is talking about this. Be a part of the conversation.
In response to xAI’s decision to remove Grok’s ability to undress people in photos, UK technology secretary Kendall said: “Our Online Safety Act is and always has been about keeping people safe on social media, especially children, and it has given us the tools to hold X to account in recent days.”
“I also want to thank those who have spoken out against this abuse, above all the victims.
“I shall not rest until all social media platforms meet their legal duties and provide a service that is safe and age-appropriate to all users.”
Ofcom also welcomed the new restrictions, but said its investigation, launched on Monday, will continue as it seeks “answers into what went wrong and what’s being done to fix it.”
Unlock exclusive Cybernews content on YouTube.
Your email address will not be published. Required fields are markedmarked