India's Ministry of Electronics and Information Technology (MeitY) has issued a stringent directive to Elon Musk's social media platform X, demanding immediate technical and procedural modifications to its AI chatbot, Grok. The order comes after numerous users and lawmakers flagged the generation of "obscene" content, including AI-altered images of women and sexually explicit material, prompting concerns over the platform's content moderation safeguards.
Issued on Friday, the directive mandates X to take corrective action on Grok, specifically restricting the generation of content involving "nudity, sexualization, sexually explicit, or otherwise unlawful" material. The ministry has given X a strict 72-hour deadline to submit an action-taken report, detailing the measures implemented to prevent the hosting or dissemination of content deemed "obscene, pornographic, vulgar, indecent, sexually explicit, pedophilic, or otherwise prohibited under law."
Failure to comply with this order could have significant repercussions for X. The ministry warned that non-compliance could jeopardize the platform's "safe harbor" protections, which grant legal immunity from liability for user-generated content under Indian law. This legal shield is crucial for social media platforms operating in the country.
The Indian government's move follows a surge of complaints from users who shared instances of Grok being prompted to alter images of individuals, predominantly women, to make them appear in bikinis. This led to a formal complaint from Indian parliamentarian Priyanka Chaturvedi. Additionally, recent reports highlighted cases where the AI chatbot generated sexualized images involving minors, an issue X acknowledged earlier on Friday was due to lapses in its safeguards. While images involving minors were subsequently removed, TechCrunch reported that AI-altered images depicting women in bikinis remained accessible on X at the time of publication.
This latest order reinforces a broader advisory issued by the Indian IT ministry just days prior. On Monday, the ministry reminded all social media platforms that adherence to local laws governing obscene and sexually explicit content is a prerequisite for retaining legal immunity for user-generated material. The advisory urged companies to strengthen internal safeguards, cautioning that non-compliance could lead to legal action under India's IT and criminal laws.
"It is reiterated that non-compliance with the above requirements shall be viewed seriously and may result in strict legal consequences against your platform, its responsible officers and the users on the platform who violate the law, without any further notice," the order warned.
India, one of the world's largest digital markets, is emerging as a critical test case for government oversight of AI-generated content. Any tightening of enforcement within the country could establish significant precedents and have ripple effects for global technology companies operating across multiple jurisdictions.
The directive also comes as X continues to challenge aspects of India's content regulation rules in court, despite generally complying with most blocking directives. Concurrently, Grok has seen increasing use by X users for real-time fact-checking and commentary on news events, making its outputs more visible and, consequently, more politically sensitive than those of standalone AI tools.
As of the time of this report, X and xAI have not responded to requests for comment regarding the Indian government's order.
