anthropic

SAN FRANCISCO, California: Anthropic said Thursday it shut down multiple cases of state-sponsored surveillance operations that used its artificial intelligence (AI) models, and warned that governments and state-aligned actors are increasingly using AI to spy on ethnic minorities and dissidents.

The incidents were found and disrupted between January and July, and they originated in China, Iran and west Africa, Anthropic said in a report about misuse of its models.

These surveillance campaigns “targeted the same diaspora and dissident communities these regimes have historically targeted. These include pro-democracy figures in Hong Kong, Tibetan and Falun Gong communities across Asia, and Iranian minority communities and opponents of the Iranian regime abroad,” the report said.

In one case, Iranian actors developed a way to identify people through their social media accounts; in another, a contractor working for Malian national security authorities used Claude “to design the underlying software that enabled the intelligence gathering.”

“AI is now being used in place of an engineering workforce,” the report said.

Anthropic also disrupted efforts by users to design weapons, conduct questionable biological research, and create dating scams.

The San Francisco-based AI lab also accused Chinese developers of deceptively using Claude to produce responses to user queries while simultaneously “distilling” that data to improve their own models.

Distilling is an industry term that refers to a process where one AI model is used to train another one.

Chinese developers have previously been accused of using that technique without permission, essentially stealing resources from American labs such as Anthropic and OpenAI.

Now Anthropic alleges that China’s Moonshot and Deepseek have also secretly used Claude to generate answers given to its users.

“In one instance, over a ten-day period, Moonshot relayed almost 300,000 customer requests to Anthropic” through a “network of 5,380 fraudulent accounts, most of which appeared to be located in Singapore and Japan,” the report said.

Some of that data contained sensitive user information, potentially in violation of privacy agreements.

“We do not know if Moonshot notified their customers that their requests were being rerouted to Anthropic and exposed to a third party,” the report said.

Deepseek used similar techniques.

When it comes to the research Anthropic detected and blocked that was related to biological weapons, the intent of the actors was less clear-cut and the AI lab did not identify them.

“The individuals implicated in these case studies are working scientists. We do not assert that they intended harm, and identifying them or their labs could expose them to harm,” the report said.

The scientific research in those cases involved work around the mosquito-born chikungunya virus, a “highly-pathogenic” strain of the bird flu, a family of viruses that include smallpox and mpox, venoms and other toxins.

Court order rules that Pentagon acted illegally, punishing AI company for criticism of government.

A United States judge has blocked the Pentagon’s blacklisting of technology company Anthropic.

In a 59-page written order issued on Thursday night, District Judge Rita Lin ruled that the Department of Defense had acted illegally when it designated the company a supply chain risk to national security.

The decision marks the latest turn in the Claude maker’s high-stakes fight with the US military over artificial intelligence safety on the battlefield. The government is expected to fight the ruling.

The judge’s order rebuked the Pentagon, saying it had targeted and punished Anthropic for the company’s public criticism of the Defense Department’s stance on AI deployment on the battlefield.

“The empty invocation of national security is not a blank check to punish and retaliate against government critics,” Lin, an appointee of former President Joe Biden, wrote.

Autonomous weapons and domestic surveillance

Anthropic’s lawsuit in a California federal court alleges that Defense Secretary Pete Hegseth overstepped his authority when he designated the company a national security supply-chain risk.

Hegseth’s move, which blocked Anthropic from military contracts, followed the company’s refusal to allow the military to use its Claude AI models for US surveillance or autonomous weapons.

Anthropic argues that AI models are not reliable enough for autonomous weapons and opposes domestic surveillance. The Pentagon maintains that private companies should not constrain military action.

Executives have said the ban could cost the company billions of dollars in lost business.

During a hearing on July 30, Lin described the government’s position as “really troubling” and “at odds … with the First Amendment”, adding that the record had “gotten worse for the government” over time.

In the same hearing, Department of Justice lawyers argued that the nature of AI models is “so staggeringly enormous and opaque” that the Pentagon cannot evaluate them like physical hardware.

First use of obscure statute

Anthropic welcomed the ruling, stating it remained “focused on working productively with the government to harness AI for our national security so all Americans benefit from this technology”.

The designation was the first time a US company has been publicly labelled a supply-chain risk under an obscure procurement statute aimed at protecting military systems from foreign sabotage.

In its lawsuit, Anthropic alleged the government violated its constitutional rights to free speech and due process by retaliating against its views on AI safety without allowing it to dispute the claim.

The lawsuit called the decision unlawful, unsupported by facts, and inconsistent with the military’s past praise of Claude.

There was no immediate comment from the Pentagon on the ruling.