Malaysia and Indonesia have moved to block access to Grok, an AI chatbot developed by xAI, after authorities found it was being widely misused to create non-consensual and sexually explicit deepfake content. Officials in both countries said existing safeguards were insufficient to prevent the generation and spread of harmful AI-created images, raising serious concerns about privacy, safety, and abuse.
In Indonesia, regulators framed the issue as both a public safety and human rights concern. The government said AI-generated sexual deepfakes, particularly those involving women and minors, pose significant risks and violate personal dignity. As a result, access to the tool was restricted until stronger moderation and preventive mechanisms are put in place.
Malaysia’s communications authorities took similar action, ordering a temporary block after repeated cases of obscene and manipulated imagery were linked to the chatbot. Officials emphasized that platforms offering powerful generative AI tools must demonstrate effective content controls, especially in countries with strict laws governing online harm and decency.
These actions mark a significant moment in global AI regulation, as Malaysia and Indonesia become among the first nations to take direct steps against a major AI system over deepfake abuse. The move reflects a growing willingness by governments to intervene when AI tools are seen as enabling harm, and it signals that stricter oversight of generative AI platforms is likely to expand worldwide.
