Malaysia and Indonesia Ban Elon Musk’s Grok Over Deepfake Concerns

Malaysian and Indonesian authorities have taken decisive action to block access to Elon Musk’s artificial intelligence chatbot, Grok. The ban, enacted in March 2024, responds to escalating concerns regarding the platform’s role in generating sexually explicit and non-consensual deepfake images. Integrated into Musk’s social media platform, X, Grok allows users to create and manipulate images, leading to significant misuse.

Both countries’ communications regulators highlighted that Grok has increasingly been exploited to alter images of individuals, depicting them in sexualized or revealing manners without consent. This situation prompted both Malaysia’s Communications and Multimedia Commission and Indonesia’s Ministry of Communications and Digital Affairs to act in order to protect vulnerable populations, particularly women and children, from digital exploitation.

The ban marks a significant milestone as the first known national prohibitions of the AI tool globally. Malaysia’s regulatory body had previously issued warnings to X, urging the implementation of stronger safeguards due to the recurring misuse of Grok for harmful content creation. Authorities noted that the company’s responses primarily focused on improving user reporting mechanisms rather than addressing the underlying risks associated with the platform’s structure.

Meutya Hafid, Indonesia’s Minister of Communications and Digital Affairs, articulated the government’s concerns. She referred to the production of sexually explicit AI-generated images as a violation of human rights and personal dignity. The Indonesian government has a history of strict regulations against online pornography, having previously banned platforms such as OnlyFans and Pornhub. Officials expressed that AI-generated sexual content poses similar threats to society.

Reports from several Indonesian users indicate that they have been victimized by manipulated images generated through Grok. Notably, disability rights advocate Kirana Ayuningtyas recounted her distressing experience when a stranger used the chatbot to alter her photograph, depicting her in a bikini. Despite her attempts to adjust privacy settings and report the image, she found it remained accessible online, describing the ordeal as “humiliating” and a violation of her personal integrity.

Pressure on Grok is escalating beyond Southeast Asia, with similar concerns emerging in Europe. In the United Kingdom, Liz Kendall, the Technology Secretary, has voiced support for stricter measures against X in light of online safety issues. The media regulator Ofcom is anticipated to decide on potential restrictions related to such platforms in the near future.

The creation of sexualized deepfakes has faced widespread condemnation from global leaders. UK Prime Minister Keir Starmer characterized the content as “disgraceful” and “disgusting.” In response to criticism, Elon Musk has previously dismissed concerns regarding X, suggesting that they may be attempts to justify censorship.

Both X and Grok have been contacted for comments regarding the bans and ongoing concerns. The situation highlights an urgent need for effective measures to mitigate the risks associated with AI-generated content, particularly in relation to personal dignity and safety.