Memphis-based Grok, the AI chatbot developed by xAI, is facing mounting legal and regulatory pressure around the world over its ability to generate sexualized images of children and women.

Access to Grok has been blocked in Indonesia and Malaysia. Government officials in India have demanded explanations from the company, while regulators in the United Kingdom formally opened an investigation Monday.

Until recently, all Grok users could upload images of real people and prompt the AI to undress them or place them in sexualized positions. xAI later restricted the image-generation tool to paid subscribers. Officials in the UK government called the move “insulting,” according to Sky News.

According to Reuters, Elon Musk said last week that anyone using Grok to create illegal content would face the same consequences as uploading such material directly.

Below is a breakdown of Grok’s expanding legal troubles worldwide.

United Kingdom:

Ofcom, the UK’s independent online safety watchdog, opened a formal investigation into X (xAI’s parent company) Monday “to determine whether it has complied with its duties to protect people in the UK from content that is illegal in the UK.”

“There have been deeply concerning reports of the Grok AI chatbot account on X being used to create and share undressed images of people – which may amount to intimate image abuse or pornography – and (sexualized) images of children that may amount to child sexual abuse material (CSAM),” the agency said in a statement Monday.

Ofcom said it made contact with X on January 5, heard back from the company on January 9, and opened the investigation on January 12. Grok’s images may violate the UK’s Online Safety Act. The law protects people from content that is illegal in the UK, and protects UK children from other content that is “harmful to them, such as pornography.”

If X is found in violation of the law, it could face fines of up £18 million (about $24 million) or 10 percent of qualifying worldwide revenue, whichever is greater. If the company fails to comply, Ofcom could force advertisers from the site or block access to it altogether.

“Reports of Grok being used to create and share illegal non-consensual intimate images and child sexual abuse material on X have been deeply concerning,” Ofcom officials said in a statement. “Platforms must protect people in the UK from content that’s illegal in the UK, and we won’t hesitate to investigate where we suspect companies are failing in their duties, especially where there’s a risk of harm to children.

“We’ll progress this investigation as a matter of the highest priority, while ensuring we follow due process. As the UK’s independent online safety enforcement agency, it’s important we make sure our investigations are legally robust and fairly decided.”

Indonesia:

Indonesia temporarily blocked Grok on Saturday, “in order to protect women, children, and the wider public from the risks of fake pornographic content generated using artificial intelligence technology.”

Indonesian law says, basically, websites can’t “contain, facilitate, or disseminate prohibited electronic information or documents.”  

“The government views non-consensual sexual deepfakes as a serious violation of human rights, personal dignity, and the security of citizens in the digital space,” said Meutya Hafid, Minister of Communication and Digital Affairs said in a statement. “The Ministry of Communication and Digital Affairs has also requested platform X to appear promptly in order to provide clarification regarding the negative impacts arising from the use of Grok.”

Malaysia:

Malaysian officials temporarily blocked Grok Tuesday, according to state news agency Bernama.

The move came after X gave inadequate responses to government officials about Grok’s ability to generate sexualized images of children. Communications Minister Datuk Fahmi Fadzil told reporters in Shah Alam Tuesday that the company was contacted last week for clarification but their “response was unsatisfactory.”

For this, Fadzil put a temporary block on Grok and is considering legal action against the company. The duration of the block will depend on X’s level of complaint with Malaysian law, he said. He also noted it wasn’t the entire X platform, just Grok from xAI.

“This also reflects global alarm over Grok’s failure to provide adequate safeguards in the use of AI,” Fadzil said.

 India:

Government officials in India asked X to remove obscene content on January 2, according to state news agency News On Air.

In a letter, officials said “Grok AI is being misused by users to create fake accounts to host, generate, publish or share obscene images or videos of women in a derogatory or vulgar manner.”With this, the company is breaking Indian law, it said.

The government is seeking action from the company. Non-compliance, it said, “will be viewed seriously and may result in strict legal consequences against the social media platform.”