India Govt Unsatisfied With X Response on Grok AI Misuse

India Govt Not Satisfied with X Response on Grok AI Misuse, Considers Next Steps

India’s technology ministry is considering further action against social media platform X after reviewing the company’s response on the misuse of its artificial intelligence chatbot, Grok.

Officials say the explanation lacks clear details about how the platform will stop the creation and spread of objectionable AI-generated images. Many complaints involve images targeting women.

The issue has triggered a wider debate about regulating artificial intelligence tools and defining the responsibilities of large technology platforms.

How the Grok Controversy Began

The controversy began after some users reportedly used Grok, the AI chatbot integrated into X, to create manipulated and sexualised images of women without consent.

Authorities say users misused the technology to generate obscene or degrading content through prompts and image manipulation tools.

These incidents raised concerns within India’s Ministry of Electronics and Information Technology (MeitY). Officials warned that the platform may have failed to enforce safeguards required under Indian law.

The ministry later issued a notice asking X to explain the safeguards built into its AI systems. Authorities also asked the company to detail actions taken against violators.

Government Says Response Lacked Specifics

X later submitted a response along with an action-taken report describing its content moderation policies.

However, officials say the explanation relied mainly on general assurances rather than clear technical measures.

Government sources said the company did not clearly explain how it would prevent misuse of Grok. They also said the response lacked details about structural safeguards.

Authorities have now asked the platform to provide more information about several issues, including:

• Content moderation tools used to monitor AI outputs
• Technical safeguards designed to block abusive prompts
• Action taken against accounts generating such content
• Compliance with India’s IT rules

Officials also warned that social media platforms must follow India’s digital laws strictly.

What X Has Said So Far

According to officials familiar with the matter, X told the government it would take action against users who generate illegal content using Grok.

The company said it may permanently disable accounts that create such content. It also said moderators would remove offending posts.

X reported that it has already removed thousands of pieces of objectionable content. The platform also suspended hundreds of accounts after the issue surfaced.

The company added that users who prompt Grok to create illegal images will face the same consequences as those who upload illegal content directly.

However, regulators believe stronger safeguards must exist at the AI system level rather than relying only on user enforcement.

A Wider Global Debate Over AI and Deepfakes

The Grok controversy reflects a growing global concern about the misuse of generative AI tools.

In recent years, image-generation systems have become much more powerful. However, people have also used these systems to produce deepfake content, including manipulated images of real individuals.

Some reported cases involving Grok included AI-generated images that altered photos of women without consent or placed them in sexualised situations.

Such incidents have prompted governments worldwide to push for stricter AI safety regulations.

Regulators in Europe, the United Kingdom and several Asian countries have already started reviewing the risks posed by generative AI platforms.

India’s Growing Focus on AI Regulation

India has recently increased its focus on regulating artificial intelligence and digital platforms.

Under the Information Technology Act and intermediary rules, social media platforms must remove illegal content once authorities notify them.

If companies fail to comply, they may lose “safe harbour” protection. This legal protection shields platforms from liability for user-generated content.

Officials say the government wants to prevent misuse of AI technologies while still allowing innovation to grow.

For now, the ministry is reviewing additional information requested from X before deciding its next steps.

The dispute highlights a larger challenge for governments worldwide: how to regulate rapidly evolving AI systems without slowing technological progress.