First US state takes action against xAI and Grok over sexualized AI images
Elon Musk claims to have had no knowledge of child nudity images created by AI on X. Like other countries, California is now starting investigations.
(Image: lilgrapher/Shutterstock.com)
The US state of California is the first official body in the USA to deal with the sexualized AI images of women and children on Elon Musk's online platform X. California Attorney General Rob Bonta initiated an investigation on Wednesday into the dissemination of sexually explicit material generated by Grok, an AI model developed by xAI. Previously, other states and the EU had already announced or initiated corresponding steps.
On X, users can prompt Grok to create AI images or modify photos using AI. Some users have apparently used this to generate images of clothed women and children in a state of undress -- without the knowledge or consent of the individuals depicted. A 24-hour analysis revealed that X users have been creating thousands of publicly accessible sexualized deepfakes every hour. As part of its investigations into the company, the EU has increased pressure on Elon Musk's X over Grok's AI images of children. Meanwhile, Indonesia and Malaysia have become the first countries to block Grok due to these sexual deepfakes.
Elon Musk sees no child deepfakes
Elon Musk appears surprised and stated on X a few hours ago that he is “not aware of any underage nudity images generated by Grok, absolutely none.” According to the tech billionaire, “Grok refuses to create illegal content when asked to generate images, as it fundamentally adheres to the laws of the respective country or federal state.” If users were to trick Grok into doing so, for example “via a hacker attack,” the error would be corrected immediately.
California Governor Gavin Newsome sees it differently and described “xAI's decision to create and operate a platform for pedophiles to disseminate non-consensual, sexually explicit AI deepfakes, including images that digitally undress children,” in a post on X as “abhorrent.” Therefore, he has “urged the California Attorney General to immediately investigate the company and hold xAI accountable.”
Videos by heise
Rob Bonta has immediately followed suit and initiated a corresponding investigation into xAI. “The flood of reports detailing the non-consensual, sexually explicit material that xAI has produced and published online in recent weeks is shocking,” Bonta stated according to a press release. “I urge xAI to take immediate action to prevent further progression of this development. We will not tolerate the AI-assisted creation and dissemination of non-consensual intimate images or material depicting child sexual abuse in any way.”
Britons have a deepfake law; Germany wants one
In Great Britain, they are already one step ahead. Apps that digitally undress people are to be banned there. Due to Grok's activities on X, the British government and media regulator are taking action against Grok and want to enforce a new law. The fact that X recently restricted image generation to paid accounts and largely refuses image generation is “not nearly enough” in the view of the British Minister for Technology. It is an insult to the victims to say that the service is still available; you just have to pay for it.
Empfohlener redaktioneller Inhalt
Mit Ihrer Zustimmung wird hier ein externes YouTube-Video (Google Ireland Limited) geladen.
Ich bin damit einverstanden, dass mir externe Inhalte angezeigt werden. Damit können personenbezogene Daten an Drittplattformen (Google Ireland Limited) übermittelt werden. Mehr dazu in unserer Datenschutzerklärung.
In Germany too, the call for stricter rules against AI-generated sex images is growing louder. Federal Minister of Justice Stefanie Hubig wants to take tougher action against the creation and distribution of sexualized images generated by artificial intelligence. Those affected should be better protected from such AI image manipulations, and Hubig demands that the “criminal law be sharpened once again.” Furthermore, her ministry is “currently drafting a digital protection law,” which provides for penalties for deepfakes that violate the personal rights of those affected.
California is not yet that far. Attorney General Bonta did not provide details yesterday about the scope of the investigations into xAI and Grok or whether criminal charges are involved.
(fds)
