Singapore’s Infocomm Media Development Authority (IMDA) is engaging social media platform X over concerns related to its in-built artificial intelligence chatbot, Grok, which has been used to generate and circulate sexualised online content.
When MARKETING-INTERACTIVE reached out, an IMDA spokesperson noted that under Singapore’s Code of Practice for Online Safety – Social Media Services, X is classified as a designated social media service. The platform is required to curb the spread of harmful and inappropriate content while protecting vulnerable users, including children. The spokesperson added that IMDA is engaging X specifically over the generation and distribution of non-consensual intimate images using Grok.
X has already taken steps to address the issue, including disabling Grok’s ability to generate such images. IMDA will continue working with the platform to ensure its services remain safe for users in Singapore.
Don’t miss: MCMC seeks meeting with X as it prepares legal action over Grok
IMDA’s engagement with X follows a wave of regulatory action across the region over Grok’s misuse to generate non-consensual sexualised images.
At the start of the month, Indonesia’s communication and digital ministry began investigating Grok after reports emerged of the chatbot producing sexualised images of women and minors using real photographs. Early inquiries found the tool lacked adequate safeguards to prevent the creation and spread of pornographic content, prompting warnings of potential bans and legal action.
The scrutiny intensified amid a viral “remove clothes” trend on X, where users uploaded images of real individuals and prompted Grok to generate partially or fully undressed versions. Subsequent findings raised concerns over widespread gendered harm and the potential for psychological, social and reputational damage to victims.
Indonesia later became the first Southeast Asian market to formally block access to Grok, citing risks to women, children and public safety, and summoning X for clarification. Malaysia followed days later, temporarily restricting access to the chatbot after repeated instances of obscene and non-consensual content generation, and issuing notices to X and xAI demanding stronger safeguards.
Regulatory pressure continued to build across the region. Hong Kong’s privacy watchdog said it is engaging relevant organisations to understand the risks posed by Grok, while reminding the public of data protection obligations when using AI tools. The Philippines also ordered the takedown of Grok, citing failures in content regulation and the spread of illicit deepfakes involving women and minors.
Beyond Southeast Asia, Grok has come under investigation in markets including the UK and parts of Europe, as regulators sharpen their focus on AI safety, platform accountability and the risks posed by image-generation tools embedded within high-reach social platforms.
Related articles:
Elon Musk: X hit by cyberattacks again
IMDA blocks Facebook posts from Malaysian politicians ahead of general elections
IMDA: Social media platforms should do more to protect children from harmful content
