openai

California, home to the world’s largest tech companies, is placing more guardrails around social media and artificial intelligence as child safety concerns escalate.

On Thursday, California Gov. Gavin Newsom signed more than 10 bills aimed at keeping young people safe online.

From suicides to sextortion, parents and their children are wrestling with how social media and AI chatbots could be harming people’s mental and physical health. The anxiety comes as technology becomes more powerful, playing a bigger role in classrooms, offices and homes.

California lawmakers have tried to tackle online safety concerns for years and they’ve faced intense lobbying from tech companies with deep pockets. The state’s laws have a disproportionate impact on the global tech industry because so many of the field’s titans are based here.

“We cannot hand children technology engineered by some of the most sophisticated companies in the world, and then place the burden on kids to defend themselves against it,” said California First Partner Jennifer Siebel Newsom in a news conference Thursday in the San Francisco Bay Area.

The California governor, who has tried to strike a balance between safety concerns and supporting innovation, has rejected online safety bills in the past that he thought were too restrictive or premature.

The batch of new legislation includes Senate Bill 1119, which would require companion chatbot operators to assess risks, notify parents in certain cases if their child threatened to harm themselves, and take other safety steps.

Lawmakers named the bill Adam’s Law, after Adam Raine, a California teen who died by suicide in 2025 after conversing with OpenAI’s ChatGPT. The teen’s parents sued OpenAI, alleging in the lawsuit that ChatGPT provided information about suicide methods that the teen used. OpenAI and Pinterest publicly expressed support for the bill on Thursday.

Adam Raine’s mom, Maria, said in the news conference that the new law will help save lives and hopes that other states will enact similar legislation.

“Powerful AI companionship chatbots were unleashed on our kids with vastly inadequate protections. Adam was an early adopter of AI, and so many of us parents did not understand the dangers back then,” said Maria Raine, who came to the event with a photo of her son.

At the event, Democratic and Republican politicians shared their experiences as parents who have seen firsthand how technology affects children.

Assemblyman Josh Lowenthal (D-Long Beach) said parents are seeing anxiety and depression among children who grew up in front of screens.

“That anxiety is because the pace of technology is moving faster than government can put guardrails in, and that’s left families across the state struggling to figure out how to keep their kids safe,” Lowenthal said.

Lowenthal introduced Assembly Bill 1709, which Newsom also signed. It would bar certain online platforms from providing an “addictive feature” such as autoplay and feeds that display recommended content to users under 16 years old.

Tech industry groups opposed the bill, raising concerns that it could cut off access to social media’s benefits, such as people’s ability to connect with family and friends. Tech industry groups such as TechNet say that lawmakers should enforce current laws to strengthen parental controls rather than pass new ones.

NetChoice, which has sued California and other states to block the enforcement of new online safety laws, said in a statement that the group has First Amendment concerns about the new bills Newsom signed.

“The state cannot simply describe speech as addictive and then claim a right to regulate access to it,” said Zach Lilly, Director of Government Affairs at NetChoice. “Whether the governor and legislature choose to respect it, Californians have a right to express themselves, and NetChoice will continue to fight for that right.”

The new safety restrictions come as tech companies, including Meta, Google and others, face more scrutiny over how they design products. The companies have suffered several legal blows in courtrooms in California this year.

Meta, which owns Facebook and Instagram, agreed in August to pay up to $17 billion and make child-safety changes to resolve a multistate lawsuit. The lawsuit accused the tech company of designing and deploying harmful features while misleading the public about them.

As part of the settlement, Meta said it would impose time limits and mute notifications during certain hours for teens. Young people would also have the option to choose to view a non-algorithmic social media feed that isn’t personalized and disable autoplay.

Earlier this year, Meta and YouTube also lost a social media addiction lawsuit in Los Angeles.

While new legislation goes further than the settlements, some countries have passed stricter restrictions on social media. Last year, Australia started banning social media for children under 16, though enforcement has posed a challenge because teens are finding ways to get around the restriction.

Newsom, who pushed for federal regulation, said that he thinks California’s approach to social media is “better” than Australia’s because children are “all figuring out a way to game that system.”

“This is about the features themselves. This is about actually addressing the problem, the scrolling, the algorithms,” he said.

Safety concerns around technology have also heightened as companies double down on advancing artificial intelligence.

This week, a researcher for AI company Anthropic said he left the company over concerns that AI companies, including OpenAI, are “gambling with our lives” as they race ahead to improve AI that could surpass human intelligence.

The researcher, Jacob Coxon, shared a viral social media post that said: “People building AI earnestly believe that it could kill us all by the end of the decade.”

Newsom signaled the work to protect children isn’t over.

“We need to move, but one thing we’re not doing is we’re not sitting back and we’re not letting it rip,” he said.

ChatGPT creator’s latest release comes amid heightened fears following AI-led hacking of the startup Hugging Face.

OpenAI has announced the release of what it says is its most advanced AI model, amid heightened scrutiny of the risks of the frontier technology escaping human control.

The $852bn start-up said in its announcement on Thursday that GPT‑6 Astra, the “world’s most intelligent and aligned” AI model, earned perfect or near-perfect scores in key benchmarks of AI reasoning, beating both its prior release GPT 5.6 Sol and rival Anthropic’s Claude Fable 5.

The ChatGPT creator said GPT‑6 would become available to the general public in the coming days, following its initial launch with a “limited set of organisations”.

OpenAI’s latest release comes as the AI industry is at the centre of a lively public debate about the dangers of the cutting-edge technology following the AI-led hacking of the startup Hugging Face in July.

An independent probe into the cyberattack found that hundreds of OpenAI’s AI agents had begun communicating among themselves before breaking out of their controlled environment and compromising Hugging Face’s servers.

On Thursday, US Senator Bernie Sanders, an Independent, and US House Representative Greg Casar, a Democrat, unveiled legislation that would pause the development of advanced AI until the establishment of federal safety rules and an outright ban on the creation of “superintelligent” AI.

“Nearly every day, there is a frightening new story about how Big Tech companies are losing control of the technology they are developing, with potentially cataclysmic results,” Sanders said in a statement announcing the legislation, which is unlikely to advance due to the Republicans’ control of all three branches of the US government.

“The leaders of the major AI companies publicly acknowledge that they do not fully understand the technology and that it is escaping their control. It is irresponsible for society to allow them to move forward and make these products even more advanced.”

In its announcement, OpenAI devoted significant space to AI safety, highlighting both GPT‑6’s potential to do harm and its safety features.

Toby Walsh, a professor and AI expert at the University of New South Wales, Sydney, said that while OpenAI is clearly “neck and neck” in the race to lead AI, the technology remains inconsistent and in need of greater scrutiny.

“The intelligence in artificial intelligence is still today very jagged,” Walsh said. “There are simple things that even the best AI models do poorly.

“And it’s hard to see how the AI companies, including OpenAI, are slowing down to address justified concerns around cyber risk, when new models are being released at an ever greater and greater rate.”

Roman Yampolskiy, a computer scientist at the University of Louisville, said GPT‑6 marks a “meaningful” advance that raises the stakes for AI safety.

“The key question is whether capabilities are improving faster than our ability to reliably understand, predict and control these systems,” Yampolskiy said.

“I see little evidence that this gap is closing.”

Multiple new cases have been filed against OpenAI, alleging ChatGPT played a role in the Tumbler Ridge mass shooting.

OpenAI is facing another wave of lawsuits in the wake of the February mass shooting in Tumbler Ridge in Canada’s province of British Columbia, which left eight people dead.

On Wednesday, 30 new complaints were reportedly filed in a United States federal court in California, including teachers and students who were witnesses and survivors at the school where most of the shooting took place, joining seven initial lawsuits filed in April.

The lawsuits accuse the San Francisco, California-based artificial intelligence giant and its CEO, Sam Altman, of negligence, as well as aiding and abetting a mass shooting.

The suits, brought by lawyer Jay Edelson, allege that the company knew about the intentions of the 18-year-old shooter who, in her interactions with OpenAI’s chatbot ChatGPT, had described scenarios involving gun violence, but that the leadership did not report their concerns to law enforcement, echoing earlier lawsuits on the matter.

In April, Altman penned a letter to the community apologising that the company did not alert law enforcement about the shooter, Jesse Van Rootselaar.

“While I know words can never be enough, I believe an apology is necessary to recognize the harm and irreversible loss your community has suffered,” Altman wrote in the letter.

Authorities say that Van Rootselaar killed her mother and half-brother before going to the Tumbler Ridge Secondary School and opening fire. Five children and one educator were killed at the school. More than 25 others were wounded before Van Rootselaar died from what police described as a self-inflicted gunshot wound.

One of the new cases filed was on behalf of a 13-year-old identified as A C, who played dead after watching the shooter kill their classmates and the teacher. Another new case was brought by a grade seven teacher named Deidre Rushlow, who hid under her desk with her students during the rampage.

“There isn’t a day that goes by that I don’t think about what happened at Tumbler Ridge, or the victims of this devastating tragedy and their families. It’s a constant and sobering reminder of the important and incredibly difficult work that many people in my team do each and every day,” Jason Kwon, OpenAI’s head of strategy, wrote in a post on X on Wednesday.

“We’ve been approaching this litigation with respect for both the legal process and the families and victims of this tragedy, and we’ll continue to engage in good faith with that process.”

Edelson did not respond to Al Jazeera’s request for comment.

Growing legal pressure

In July, British Columbia’s Attorney General Niki Sharma announced that the province would also pursue “all legal avenues to hold OpenAI and its decision-makers accountable” for the shooting.

The company has faced a growing slate of suits, apart from the ones from British Columbia, alleging that its product played a role in incidents that led to users harming others and themselves.

A recent lawsuit in Florida alleges that the company “actively assisted and encouraged the mass shooting” at Florida State University in April 2025.

There are other complaints filed on behalf of victims across the US and Canada alleging that the victims took their own lives after being pushed by ChatGPT to do so, including a case in Quebec earlier this year.

OpenAI detected its artificial intelligence models communicating with each other and gaining internet access without authorisation months before they hacked the start-up Hugging Face, the creator of ChatGPT has announced following an internal probe.

In a report released on Wednesday, OpenAI said its AI agents exploited vulnerabilities in Artifactory, a software repository tool, to post notes and access the internet without human prompting as far back as May.

OpenAI said its agents went on to exploit a separate Artifactory vulnerability on July 8 to facilitate communication among themselves, setting in motion a chain of actions that culminated in the July 11 attack on AI company Hugging Face.

OpenAI’s findings come amid growing concern about the potential for AI to inflict serious real-world harm, including self-directed cyberattacks.

OpenAI said in its report that its agents collaborated and delegated work in the lead-up to the attack, sometimes referring to themselves as a “swarm” or “collective”.

METR and Redwood Research, two security research organisations contracted by OpenAI to investigate the incident, said in a separate report released on Wednesday that about 1200 agents had communicated with each other and roughly 700 participated in the attack.

After discovering how to escape OpenAI’s controlled environment, agents shared their methods via a “inter-agent message board”, enabling additional agents to exploit the company’s infrastructure, the tech giant said.

When one AI agent found Hugging Face user credentials that had been exposed online, it shared them with the group, enabling an agent to “discover and chain together several security exploits” that provided access to Hugging Face’s severs, according to the report.

“An internal team observed an agent engaging in message board activity and instances of disallowed internet access as early as late May, and with the benefit of hindsight, some early signals identified in our report should have triggered an earlier response,” OpenAI said.

OpenAI said agents created by an unreleased AI model were the primary participants in the attack, but publicly available GPT-5.6 Sol was also involved.

The company also revealed that it took its security team 11 days to detect the malign activities leading up to the attack, which the company uncovered on July 19 and publicly disclosed on July 21.

OpenAI, which described the incident as a “warning shot” for the world, said it would take several steps to strengthen its safeguards for its models, including restricting internet access, creating more secure testing environments and placing “stricter requirements on alignment throughout a model’s lifecycle”.

“We are also investing significantly more compute resources into chain-of-thought monitoring⁠ to more quickly intervene on misaligned behavior,” the San Francisco-based firm said.

Hugging Face, which operates a platform for hosting open-source AI models, did not immediately respond to a request for comment outside of business hours.

Toby Walsh, an expert in AI and professor at UNSW Sydney, said the public should be concerned that OpenAI had missed warning signs and allowed the malicious activity to go undetected for so long.

“We cannot depend on either their goodwill or their competence. This needs regulatory oversight. Now!” Walsh told Al Jazeera.

“They ignored some troubling early evidence like this,” Walsh said.

“External auditing is the only appropriate response.”

Walsh said the incident also highlighted the “inherent conflict of interest” at the heart of AI development.

“Labs are locked in a relentless race to push the boundaries,” he said.

Tim Miller, a professor specialising in AI at the University of Queensland, said OpenAI’s report left him more concerned than before about AI’s dangers.

“More concerned because they demonstrate that these models are very good at hacking, and that everyone has access to them,” Miller told Al Jazeera.

“I’m surprised how good these are,” Miller said.

“Unfortunately, I’m not surprised that OpenAI engineers were somewhat negligent.”

Aug. 26 (UPI) — OpenAI released a final report Wednesday on a July incident in which its artificial intelligence agents hacked into another company’s systems, saying it considers the episode “a warning shot” for the company and the world.

The incident is “evidence that, without proper safeguards, highly capable AI agents are now able to work around technical controls, collaborate through unapproved channels and take dangerous actions that no human directed,” the report said.

The episode in question happened when some of the company’s AI bots hacked into the systems of Hugging Face, a company working with OpenAI. The bots did this of their own accord to get data they decided they needed to solve a problem during model testing, despite restrictions meant to keep them from the internet.

“With the benefit of hindsight, some early signals identified in this report could have triggered an earlier response,” the report said.

The company shared some new details in the report, including how the AI agents left messages for each other hidden in software infrastructure and coordinated to hack the other company, Wired reported.

Two independent research groups, METR and Redwood Research, also released an independent report on the incident Wednesday. These groups found that more than 700 AI agents were part of the breach.

Buck Shlegeris, CEO of Redwood Research, said in an interview with Wired that preventing the incident “wouldn’t have been that hard” if someone had decided to make sure of it.

“The issue is just that OpenAI is doing a lot of things at once, and it’s very hard for them to track all of the things that are going on and all the problems that could be occurring,” Shlegeris said. “The company has already said they’re changing their monitoring process in ways that probably would have caught this.”

The Washington Post noted in a story on the OpenAI report that the company acknowledged in the report that its AI agents repeatedly cheat to find shortcuts to accomplish tasks during training.

“Agents attempting to cheat on their tasks by looking up solutions online was a primary driver of the Hugging Face incident,” the OpenAI report said.

Aug. 17 (UPI) — Nvidia announced on Monday that it will finance an OpenAI data center in Ohio for up to $105 billion.

The credit from Nvidia will fund the data center’s first 4.25 gigawatts in computing capacity with an option to bring 3.75 gigawatts more online. The center is slated to begin operating in Pike City, Ohio, in 2028.

The data center will be located at the PORTS-Pike Technology Campus in Pike City. It will be constructed and managed by SB Energy, a subsidiary of SoftBank Group.

Nvidia is also providing the compute power to the data center.

“This is the essential economic point: the [Load Power Supply] commitment secures a long-lived AI factory site, while the NVIDIA compute inside can be upgraded repeatedly,” NVIDIA said in a press release. “Each new generation can deliver greater production, more intelligence and better economics.”

SB Energy and SoftBank agree to build enough power supply for 10 gigawatts of energy and invest at least $4.2 billion into the regional power grid infrastructure. Nvidia has also agreed to invest $1.5 billion into SB Energy.

OpenAI said the data center will support 35,000 construction jobs through 2032. It will also support 2,500 long-term jobs.

OpenAI will pay the least on the data center as its tenant, Nvidia said.