Sexual deepfakes: First states block Grok, criticism of Google and Apple
That the AI chatbot Grok no longer "undresses" photos in public is not enough for regulatory authorities. Meanwhile, Google and Apple are coming into focus.
(Image: lilgrapher/Shutterstock.com)
Because Grok can still be used to digitally “undress” photos of people, Indonesia and Malaysia have become the first states to stop access to the AI chatbot. This is reported by the BBC, citing the respective ministries. The Malaysian government has reportedly demanded stricter measures from the microblogging service X against the “repeated abuse” of the software but was not satisfied with the response. Indonesia has justified the temporary ban with the protection of “women, children, and society as a whole” from fake pornography, Bloomberg adds. Sexual deepfakes without the consent of the depicted persons represent a serious violation of human rights, dignity, and national security.
The step by the two Southeast Asian governments comes after Grok was restricted on the microblogging service X such that image generation is only possible in direct chats or for a fee. Previously, thousands of images per hour were generated for days, primarily depicting women and sometimes minors in underwear or bikinis. However, those who pay for X can still commission such images publicly, while other users are still served by the chatbot for such requests in direct messages or on its website. The demand from numerous states that this practice must cease has therefore not yet been met by those responsible for Grok.
Criticism of Google and Apple
Grok is developed by xAI and is primarily visible on X, both of which belong to billionaire Elon Musk. Over the weekend, he reacted to an investigation into the practice in Great Britain with critical and cryptic posts. Musk accused the government in London of censorship, among other things, calling it “fascist” in one post, reports dpa. The British media regulator Ofcom is investigating whether Grok violates the Online Safety Act. The British Prime Minister called the sexualization of women and children through AI technology “disgusting.” The restriction on image generation was deemed “insufficient” by both the British government and the European Commission.
Videos by heise
Meanwhile, criticism of Google and Apple is also growing due to their handling of Grok. Both US corporations make the associated applications available in their app stores. Together with two colleagues, US Senator Ron Wyden (Democrats) has therefore called for the apps of X and Grok to be removed from the app stores as quickly as possible. Only when Elon Musk addresses these “disturbing and likely illegal activities” should they be distributed again. The three Democrats point out that Google and Apple repeatedly claim that only safe content is distributed in their app stores. The rules applicable there would prohibit “non-consensual sexual depictions of children and women.”
(mho)
