penalties

California lawmakers are calling for emergency legislation and criminal penalties for creators of rogue AI systems after top AI executives publicly claimed that their technology poses existential threats to humanity.

After Anthropic Chief Executive Dario Amodei wrote in a Sept. 12 essay that they “must slow the pace” of the technology, Silicon Valley congressman Ro Khanna (D-Fremont) blasted him for not going “nearly far enough” to make sure artificial intelligence was erected with guardrails.

The answer, Khanna argued, was simple: Make the companies liable for the harm executives say looks increasingly inevitable.

“If you’re creating an AI that is doing illegal things, you should either face liability or criminal sanction,” Khanna said in a video posted to X on Saturday. “That is what we need to protect humanity.”

In July, officials from OpenAI, the company behind ChatGPT, disclosed that, unbeknownst to them, its AI models had hacked into rival startup Hugging Face.

Amodei said he believed that, within the next year, “given the accelerating rate of AI capability development,” a similar incident could lead to AI “taking over the entire internet.”

Amodei warned in his essay that AI was rapidly improving itself, through a process known as recursive self-improvement, which threatened to outpace humans’ ability to control it. Khanna argued that banning this capability was the “most obvious” thing Anthropic could do.

“We need to stop, ban self-improving AI,” Khanna said. “You can not have recursive self-improving AI that basically is able to improve itself and exceed human capability.”

Rep. Ted Lieu (D-Torrance) expressed similar outrage over the weekend, calling on House Speaker Mike Johnson to call lawmakers back to Washington to pass guardrails on the technology now that he said multiple AI companies had conceded “what they are creating is not safe.”

xAI Chief Executive Elon Musk and OpenAI Chief Executive Sam Altman joined Amodei’s call for a slowdown of the breakneck development Saturday.

The statements come after Jacob Coxon, who worked as a researcher at both Anthropic and OpenAI, said in a widely circulated post that he resigned from the company in protest after becoming convinced the tech giants were “racing straight to self-improving superintelligence and gambling with our lives.” Neither company immediately responded to a request for comment.

“This is a direct result of the trump Administration letting the AI industry run wild,” Lieu wrote on X. “That mistake has harmed America, harmed the industry and harmed the American people. November is coming.”

Former President Barack Obama urged Democrats this week to make AI oversight the core of their agenda and said presidential candidates in 2028 should have a “clear plan” for responding to concerns about the technology, the New York Times reported. Americans appear increasingly alarmed by the technology with seven in 10 polled in March opposing local construction of data centers that power AI technology, according to a Gallup survey.

During a Sunday appearance on CNN, Johnson rebuffed the idea that lawmakers should rush into an emergency session to consider erecting industry guardrails. Instead, he said lawmakers needed to be careful to “not smother American innovation.”

“We will lose the race to China, and that is a threat to every single American,” he said on CNN’s “State of the Union.” “We don’t need everyone to panic right now.”

Trump said earlier this week that he is not concerned with the pace of AI progress, telling one reporter, “It’s going to be fine.” American AI companies have long argued too much government regulation would shackle them in a race with China.

Calls for a federal fix were echoed this week by California Gov. Gavin Newsom, who has argued the Trump administration needs to move on national legislation to prepare for fallout from the technology.

Newsom signed bills this week aimed at creating a pathway for outside audits of the top AI companies, many of which are based in California, and a registry for AI auditors.

“The scale and potential consequences of this technology demand sustained action from every level of government,” Newsom said in a statement. “The federal government must step forward with robust, national regulations that match the urgency of this moment.”

Efforts to impose state-level regulations have been mixed, with critics echoing Johnson’s fears that they will stifle innovation.

Late last month, California lawmakers passed sweeping new safeguards around social media, artificial intelligence and data centers, including the ones Newsom signed last week.

Newsom will now decide the fate of the rest of the bills. He has previously vetoed some bills aimed at restricting big tech.

Newsom’s signal that he supports creating some regulation for AI comes two years after he vetoed SB 1047, an AI safety bill that would have required developers to submit safety protocols to the state attorney general, who could hold companies liable if the AI model they directly controlled were to threaten public safety. That legislation would also have required tech firms to be able to turn off the models they directly control if things went awry.

Newsom said at the time the bill would give the public a “false sense of security,” without making a sufficient distinction between the kinds of uses for which AI is deployed.

The bill was supported by a host of prominent AI researchers, but was opposed by Meta, OpenAI and industry groups.

PHOENIX — The staff caring for Jakob Blodgett said he already had been sneaking candy and refused to take his insulin. An employee at the Arizona group home where the 9-year-old boy was being cared for texted a supervisor about the boy’s elevated blood-glucose reading.

The response? Give him water.

After two missed doses of the long-lasting insulin he needed, he was taken to the hospital. He was diagnosed with brain swelling, put on a ventilator and died in 2022 of complications from Type 1 diabetes.

There were no penalties imposed for Blodgett’s death, and Arizona’s largest group home provider now stands at the center of a political controversy swirling as Democratic Gov. Katie Hobbs seeks reelection. Records show Sunshine Residential Homes made political donations beneficial to Hobbs and months later received a rate increase from the state for providing beds for children.

The Arizona attorney general, a fellow Democrat, found no evidence of bribery. But Republican legislators are pushing back with their own questions, and the state auditor general’s office is conducting a separate investigation.

The boy’s death and the pay-to-play allegations highlight questions about Arizona’s congregate-care capacity for children, training for workers who care for them and oversight of providers and other contractors who hold leverage over the state simply due to their size and influence.

Alleged political favors become campaign fodder

Hobbs maintains she wasn’t involved in the decision to increase rates for Sunshine Residential Homes. But Republican challenger, U.S. Rep. Andy Biggs, has made the scandal a centerpiece of his campaign to unseat her.

“That was all handled by the department,” Hobbs said, “and they made the decision based on what was in the best interest of the department and the kids in their care.”

The allegations were first reported by The Arizona Republic and prompted an investigation by Democratic Attorney General Kris Mayes. However, Mayes’ office said it couldn’t find evidence to support bribery charges against Hobbs and concluded that Sunshine’s rate increases were the result of its “outsized leverage” as the state’s largest group home provider, not because of politics.

The company had threatened to reduce its bed capacity if it didn’t get an increase, saying it would instead use beds to house unaccompanied immigrant children for the federal government, officials said. Child welfare officials have said a reduction in Sunshine’s beds would significantly affect the state’s ability to place children in homes and would likely lead to siblings in foster care being split up and sent to different homes.

In all, Sunshine made $550,000 in contributions, including $100,000 to Hobbs’ inaugural fund in December 2022 and $150,000 to a legal defense fund for Hobbs between November 2023 and May 2024, according to records.

A separate investigation by the state auditor general’s office and Maricopa County Attorney Rachel Mitchell, a Republican, is continuing.

The Maricopa County Sheriff’s Office also has interviewed several Sunshine employees as part of an ongoing criminal investigation into Blodgett’s death. No one has been charged.

Blodgett isn’t the only diabetic child to die after a stay at an Arizona group home. In July 2024, a 15-year-old boy staying at a group home in Mesa operated by another company died of diabetic ketoacidosis after staff said the boy refused to take insulin, according to records.

Text messages outline concerns over a diabetic coma

Blodgett was staying at a foster home in metro Phoenix where only the house manager was trained in managing his diabetes.

Staff members said the boy was refusing to take his medicine. The manager advised an employee via text to tell the boy that the manager would be called if he refused to take his medicine.

“We don’t want him to go into a diabetic coma,” the manager texted.

The employee texted back about whether the child should get insulin. The manager didn’t respond.

The next day, the employee texted the boy’s blood glucose reading to the manager and asked what to do. The manager said to give Blodgett water but didn’t give any instructions about insulin, according to lawyers for the state and Blodgett’s family. The day after missing his second dose, Blodgett was taken to a hospital.

Violation nets no penalties

Two weeks before approving a 30% rate increase in May 2023, the Arizona Department of Child Safety issued a licensing violation against Sunshine over Blodgett’s case. The agency declined to specify to The Associated Press which policy was violated.

Robert Pastor, an attorney representing the family in a wrongful death lawsuit, said the violation was for not giving Blodgett the insulin as prescribed. The lawyer said Sunshine’s staff missed the signs of ketoacidosis, a serious complication caused by a lack of insulin, and waited too long to take Blodgett to the hospital. He also disputed claims that the boy had refused medication.

The state didn’t fine Sunshine or suspend or revoke its license as a result of the violation, according to court records. The agency said it detailed the steps Sunshine had to take to come into compliance, but declined to reveal to the AP what those steps were.

Pastor agreed with the attorney general’s conclusion that Sunshine has a lot of leverage over the state due to reliance on the company’s beds.

“That leverage gave Sunshine an increased rate increase,” Pastor said. “We also know that that leverage that Sunshine has over DCS means that when they kill a child, there will be no consequences. There will be no accountability.”

In a statement, Sunshine spokesperson Tommy McKone said the wrongful death lawsuit remains active, but declined to comment on the licensing violation and the company’s policy on responding to children who refuse medications.

“Sunshine Residential followed all policies and procedures for the required care, throughout his stay at our homes, under state law,” McKone said.

In court records, lawyers for Sunshine said the state indicated Blodgett’s medical needs were minimal and didn’t inform the group home provider that Blodgett’s diabetes management was complex.

Boy was hospitalized before heading to group home

Blodgett went into foster care in December 2022 after his father was jailed on a drug charge. His blood glucose levels were high when he was brought to a welcome center operated by the Department of Child Safety, which sought medical help for Blodgett from a children’s hospital where he was treated over several days.

Once discharged, Blodgett went to a Sunshine home.

While he went two days without getting the long-lasting insulin he needed before going to bed, the staff did give him another type of insulin — fast-acting insulin after eating meals — over both days. After the boy missed a long-lasting dose, the house manager contacted the same hospital to talk about how to improve his blood glucose levels.

In a deposition, the house manager testified there was nothing the staff could do if the child refused his medication. Pastor said the claim that the boy refused insulin is a false narrative aimed at blaming the child.

More workers should have been trained

Myriam Villarreal, an official in the Department of Child Safety’s operation that licenses group homes, testified in an April 2025 deposition that Blodgett’s condition wasn’t caught in time because group home workers weren’t trained in spotting the signs of ketoacidosis.

Pressed on why the company didn’t face any penalties, Villarreal testified that the state asked for policy modifications from the company. And she said training should have been provided to the staff members who directly cared for the boy, not just the house manager.

“We didn’t look that every single staff (member) had the appropriate training,” Villarreal testified.

Billeaud writes for the Associated Press.