More than 1,000 tech leaders sign petition calling for pause of ‘giant AI experiments’ in response to the release of GPT-4.

An open letter, signed by more than 1,000 people so far including Musk and Apple co-founder Steve Wozniak, was in response to San Francisco startup OpenAI’s recent release of GPT-4, a more advanced successor to its widely-used AI chatbot ChatGPT that helped spark a race among tech giants Microsoft and Google to unveil similar applications.

The company says its latest model is much more powerful than the previous version, which was used to power ChatGPT, a bot capable of generating tracts of text from the briefest of prompts.

“AI systems with human-competitive intelligence can pose profound risks to society and humanity,” said the open letter titled “Pause Giant AI Experiments”.

“Powerful AI systems should be developed only once we are confident that their effects will be positive and their risks will be manageable,” it said.

Musk was an initial investor in OpenAI, and spent years on its board. His car firm Tesla develops AI systems to help power its self-driving technology, among other applications.

The letter, hosted by the Musk-funded Future of Life Institute, was signed by prominent critics as well as competitors of OpenAI like Stability AI chief Emad Mostaque.

A number of governments are already working to regulate high-risk AI tools. The United Kingdom released a paper on Wednesday outlining its approach, which it said “will avoid heavy-handed legislation which could stifle innovation”. Lawmakers in the 27-nation European Union have been negotiating the passage of sweeping AI rules.

‘Trustworthy and loyal’

The letter quoted from a blog written by OpenAI founder Sam Altman, who suggested that “at some point, it may be important to get independent review before starting to train future systems”.

“We agree. That point is now,” the authors of the open letter wrote.

“Therefore, we call on all AI labs to immediately pause for at least six months the training of AI systems more powerful than GPT-4.”

They called for governments to step in and impose a moratorium if companies failed to agree.

The six months should be used to develop safety protocols, AI governance systems, and refocus research on ensuring AI systems are more accurate, safe, “trustworthy and loyal”.

The letter did not detail the dangers revealed by GPT-4.

But researchers including Gary Marcus of New York University, who signed the letter, have long argued that chatbots are great liars and have the potential to be superspreaders of disinformation.

However, author Cory Doctorow has compared the AI industry to a “pump and dump” scheme, arguing that both the potential and the threat of AI systems have been massively overhyped.