Grok

Feb. 13 (UPI) — Brazilian authorities have ordered that Elon Musk’s platform, X, must implement measures to prevent its artificial intelligence tool, Grok, from generating sexualized content involving minors and involving adults without consent.

The case is being reviewed by Brazil’s National Data Protection Authority, the Federal Public Prosecutor’s Office and the National Consumer Secretariat. The agencies contend that, despite prior warnings, the social network failed to show effective action to curb these practices.

“X must immediately implement appropriate measures to prevent the production, through Grok, of sexualized or eroticized content involving children and adolescents, as well as adults who have not expressed their consent,” Brazilian authorities said in a joint statement.

The agencies gave the platform five days to comply with the determination, under penalty of fines and legal action.

On Jan. 20, the agencies recommended that X establish, within up to 30 days, technical and operational procedures to identify, review and remove sexualized content generated by Grok that remained available on the social network. That deadline co-existed with the requirement to adopt immediate actions to prevent new posts.

The company said at the time that it had removed thousands of posts and suspended hundreds of accounts for violating its policies.

However, Brazilian authorities said the information provided “was not accompanied by concrete evidence, technical reports or monitoring mechanisms that would allow its effectiveness to be assessed.”

Tests conducted by technical teams indicated that the platform still allows the generation and sharing of sexualized or eroticized images of minors and adults without authorization.

Since late last year, thousands of complaints in several countries have alleged that Grok responds to requests to alter photographs posted by women on social media, making them appear nude or in bikinis. At least two Brazilian women have reported being victims of these deepfakes.

The Federal Public Prosecutor’s Office ordered X to submit monthly reports on the actions taken to prevent the production of these images and pointed to a lack of transparency in the company’s response.

The National Data Protection Authority also required the platform to detail the measures implemented and provide evidence that can be verified by authorities.

The new five-business-day deadline requires the company to explain what specific actions it will take to prevent Grok from creating this type of content. The official document does not specify when clock began.

If the order is not met, the company could face fines and other administrative sanctions. Those responsible could also be prosecuted for disobedience.

The Federal Public Prosecutor’s Office said it could open broader investigations that may lead to legal action to seek damages for harm caused by the creation and dissemination of these images.

The case adds to investigations in Europe. On Feb. 3, the Paris Prosecutor’s Office searched Grok’s offices as part of a preliminary investigation into the alleged dissemination of child pornography and deepfakes. Authorities in the United Kingdom and the European Union are also examining Grok’s use to manipulate images.

Grok is developed by xAI, Musk’s artificial intelligence company, which also controls X. Earlier this month, the entrepreneur announced the merger of xAI with SpaceX, his aerospace company. SpaceX is expected to debut on the New York Stock Exchange later this year.

Commission President Ursula von der Leyen says Europe will not ‘tolerate unthinkable behaviour, such as digital undressing of women and children’.

The European Commission has launched an investigation into Elon Musk’s AI chatbot, Grok, regarding the creation of sexually explicit fake images of women and minors.

The commission announced on Monday that its investigation would examine whether the AI tool used on X has met its legal obligations under the European Union’s Digital Services Act (DSA), which requires social media companies to address illegal and harmful online content.

Brussels said the investigation would examine whether X had properly mitigated “risks related to the dissemination of illegal content in the EU, such as manipulated sexually explicit images, including content that may amount to child sexual abuse material”.

In a statement to the AFP news agency, European Commission President Ursula von der Leyen said Europe will not “tolerate unthinkable behaviour, such as digital undressing of women and children”.

“It is simple – we will not hand over consent and child protection to tech companies to violate and monetise. The harm caused by illegal images is very real,” she added.

Grok has faced a recent outcry after it was uncovered that users could ask the chatbot to create deepfakes of women and children by simply using prompts such as “put her in a bikini” or “remove her clothes”.

EU tech commissioner Henna Virkkunen said the rights of women and children in the EU should not be “collateral damage” of X’s services.

“Non-consensual sexual deepfakes of women and children are a violent, unacceptable form of degradation,” Virkkunen said in a statement.

X has been under investigation by the EU over its digital content rules since December 2023.

This month, Grok said it would restrict image generation and editing to paying customers after criticism of the tool’s capabilities.

A nonprofit organisation, the Centre for Countering Digital Hate, published a report last week that found Grok had generated an estimated 3 million sexualised images of women and children in a matter of days.

In December, the EU ordered X to pay a 120-million-euro ($140m) fine for violating the DSA’s transparency obligations.

The EU is not the only body investigating Grok’s tool; the United Kingdom’s media regulator, Ofcom, announced it had launched an investigation into X to determine whether it had complied with requirements under the UK’s Online Safety Act.