AI Experts Call for Pause on Powerful AI Development, Citing Risks to Humanity

A group of about a thousand artificial intelligence (AI) scientists, experts and industry members, including Tesla CEO Elon Musk, are calling for a suspension in the development of some AI technology. They argue that the most powerful AI systems could present extreme risks to humanity and social order. The group has released an open letter calling for a pause of at least six months in the training of AI systems more powerful than those of Microsoft-backed developer OpenAI's ChatGPT-4. The letter, signed by over 1,000 AI scientists, experts and industry members, including Elon Musk, calls for a pause in the development of AI systems more powerful than ChatGPT-4, citing concerns about potential risks to humanity and social order. The group argues that such powerful AI systems should only be developed once we are confident that their effects will be positive and their risks manageable.

Musk co-founded OpenAI and his electric car company, Tesla, uses AI in models with self-driving systems. However, Musk has been critical of efforts to regulate the self-driving system. This has led to criticism from some quarters, who point out the hypocrisy of Musk calling for a pause in AI development while simultaneously resisting regulation of his own company's AI technology.

The letter suggests shared safety measures could be developed during the proposed suspension and calls on developers to work with policymakers on governance. It also highlights the dangers of 'human-competitive intelligence,' asking, 'Should we develop nonhuman minds that might eventually outnumber, outsmart...and replace us?' The writers argue that such decisions should not be made by 'unelected tech leaders.'

The concerns come as US lawmakers begin to question ChatGPT's effect on national security and education. The European Union police force has also warned about the possible misuse of the system in phishing attempts, disinformation and crime.

This call for a pause in AI development reflects growing concerns about the potential risks and ethical implications of advanced AI systems. While the debate on AI regulation and safety continues, this open letter highlights the need for careful consideration and collaboration to ensure that AI development benefits humanity and does not pose existential threats.