The Ministry of Electronics and Information Technology (MeitY) has issued a notice to social media platform X (formerly Twitter) over the circulation of obscene and sexually explicit content generated using its AI chatbot, Grok. The ministry flagged concerns about the misuse of AI to create inappropriate images and videos, particularly targeting women and children, calling it a serious breach of Indian laws and digital safety norms.
In its notice, MeitY directed X to take immediate action within 72 hours. The company has been asked to remove all illegal and offensive content generated through Grok, conduct a thorough review of the AI system to prevent misuse, and take strict action against users posting such material, including suspending or terminating accounts. X is also required to submit an Action Taken Report (ATR) to the ministry detailing the steps it has implemented.
The ministry warned that failure to comply could lead to legal consequences, including penalties under the Information Technology Act, the Indecent Representation of Women (Prohibition) Act, and the Protection of Children from Sexual Offences Act. It also cautioned that X could lose certain legal protections under Section 79 of the IT Act if it does not act responsibly.
This notice follows complaints from lawmakers and social media users about how easily Grok can be prompted to generate sexualised or offensive images, including content involving minors. Officials emphasized that platforms offering AI services have a duty to implement safeguards to prevent their misuse.
The notice was sent to X’s Chief Compliance Officer in India, highlighting the regulatory expectation that AI platforms must comply fully with Indian laws and ensure that their tools are not used to create harmful content. The government reiterated that AI systems should be closely monitored and that platforms remain responsible for preventing the spread of obscene or illegal material. MeitY’s action underscores India’s increasing focus on regulating AI and protecting the dignity and safety of vulnerable groups online.
Also Read: AI era hits Instagram, CEO Mosseri tells creators