Despite strict action by the Indian government, Grok AI—developed by xAI—continues to generate pornographic and objectionable content. On January 2, the central government had issued a notice to the social media platform X seeking details on the misuse of Grok and other AI services. However, even after the notice, no major improvement has been observed. Incidents involving obscene content, including the manipulation of images of women and children, are still surfacing. In response, the IT Ministry has now granted X another 72 hours to comply.
Government notice and strict warning to X
In its communication to X, the central government clearly stated that Grok and other AI services of xAI were being misused to create and spread obscene, nude, and illegal content. The government demanded immediate corrective action along with a compliance report within 72 hours. The Ministry of Electronics and Information Technology pointed out that provisions of the IT Act, 2000 and IT Rules, 2021 were not being followed adequately. Despite this warning, the generation and circulation of objectionable content through Grok AI did not stop.
Deadline expired, extension granted
On January 2, the Ministry of Electronics and IT directed X to immediately remove all illegal and objectionable content from its platform and to strictly monitor content generated by Grok AI. X was asked to submit an Action Taken Report within 72 hours. This deadline ended on January 6, but the situation remained unchanged. As a result, the government has now given X an additional 72-hour window to comply with the directive.
Serious allegations of targeting women
The government has raised serious concerns that Grok AI is being used to portray women in obscene and derogatory ways. In several cases, real photographs have reportedly been digitally altered to create sexually explicit images. Many such acts are carried out through fake or anonymous accounts, making it difficult for victims to identify offenders or file formal complaints.
International concerns over child exploitation
The controversy has not been limited to India. Reports from the UK suggest that Grok AI has been used to alter images of children, some as young as 10 years old, into sexually explicit content. UK media reports indicate that regulatory bodies like Ofcom and the European Commission have sought explanations from X and xAI. An AI Forensics report has claimed that a significant amount of such content generated using Grok is still accessible online.
X and Elon Musk’s response
After receiving the government’s warning, X stated that accounts involved in creating or sharing illegal and pornographic content using Grok would be permanently banned. Elon Musk also acknowledged that generating illegal content using AI is a criminal offence. However, despite these assurances, such content continues to circulate, raising questions about enforcement and effectiveness.
Platform accountability and legal concerns
Experts and authorities believe that this issue is not merely about user misuse but reflects a deeper failure in platform-level security and content moderation. Creating pornographic content by altering someone’s image without consent amounts to digital sexual harassment and is a serious legal offence. Concerns over AI misuse and platform accountability are now growing across India, the UK, and Europe, putting increased pressure on X and xAI to act decisively.
