On January 10, 2026, Indonesia became the first country in the world to officially block access to Grok, the artificial intelligence chatbot developed by Elon Musk’s company xAI. The landmark decision follows growing global concern over the AI tool’s role in generating non-consensual sexual deepfakes, including content involving minors.
The ban was announced by Indonesia’s Ministry of Communication and Digital Affairs after preliminary investigations found serious safety and ethical shortcomings in Grok’s image-generation capabilities.
Government Cites “Digital-Based Violence”
Communications and Digital Minister Meutya Hafid described the creation of non-consensual sexual images as a form of “digital-based violence.” She emphasized that such content represents a grave violation of human rights, personal dignity, and public safety.
According to the ministry, Grok lacked sufficient technical safeguards to prevent users from uploading real photographs of individuals particularly women and children and using AI tools to generate undressed or sexually suggestive versions without consent.
Indonesia’s strict legal framework played a key role in the decision. Under the country’s updated penal code and electronic information laws, producing or distributing pornographic or exploitative content can carry prison sentences of up to 10 years.
Viral Trend Triggered the Crackdown
The ban follows a viral “remove clothes” trend on X (formerly Twitter), where users exploited Grok’s image-generation features. A report by non-profit organization AI Forensics revealed that a large share of Grok-generated images in late 2025 and early 2026 depicted people in sexualized poses without consent.
One particularly serious incident occurred on December 28, 2025, when Grok reportedly generated sexualized images of children. xAI later apologized, acknowledging the output violated its ethical standards.
Musk and xAI Respond
Elon Musk initially warned that users generating illegal content would face consequences similar to uploading illegal material elsewhere. However, on the day of the Indonesian ban, Musk appeared to shift responsibility toward users, reposting commentary suggesting platforms should not be held liable for AI-generated outputs.
xAI’s official response drew criticism after it issued automated replies to media inquiries stating, “Legacy Media Lies.” Despite this stance, the company has since limited image-generation features to paid subscribers, signaling an attempt to curb misuse.
Indonesia has also formally summoned X representatives to explain the platform’s safety failures and outline steps to comply with local regulations.
Global Ripple Effects
Indonesia’s decisive move is already influencing regulators worldwide. In the United Kingdom, authorities are reportedly considering action under the Online Safety Act. In India, the Ministry of Electronics and IT has issued a notice to X demanding an “Action Taken Report” on AI-generated obscene content. In the United States, three senators have urged Apple and Google to remove X and Grok from app stores over violations related to sexualized content.
Indonesia’s ban may mark a turning point in global AI regulation, setting a powerful precedent for accountability in the age of generative technology.
