Summary
- The UN Security Council will hear from tech leaders about AI risks on Wednesday.
- This follows a call from Anthropic's CEO Dario Amodei to decelerate AI progress and maintain U.S. chip export restrictions to China.
- The briefing occurs just two days before President Trump's summit with Xi Jinping on September 24.
On Wednesday afternoon, the UN Security Council will convene to hear from prominent figures in artificial intelligence, the very technology that raises their concerns.
Among those scheduled to address the 15-member council are OpenAI CEO Sam Altman, Anthropic CEO Dario Amodei, AI safety specialist Yoshua Bengio, and Hugging Face CEO Clément Delangue. They will discuss the potential dangers associated with artificial intelligence, which the council has the authority to address through sanctions and military measures.
Myriad: Predict the future of Nvidia stock. Click to make your prediction.DeepSeek, a Chinese startup that significantly impacted Nvidia's market value with its budget-friendly model launch in January 2025, has also been invited to present, along with another Chinese company, Moonshot, known for developing the Kimi models.
This session is organized by France, which currently holds the rotating presidency of the council. Foreign Minister Jean-Noël Barrot will lead the meeting, focusing on the risks of AI systems potentially operating beyond human oversight.
The discussion is expected to include concerns regarding AI's capability to orchestrate cyberattacks, influence elections, or autonomously design weaponry without human intervention. This shift to tech leaders rather than military officials reflects the council's evolving focus.
Dario Amodei will participate remotely. On September 12, he published an essay titled "We Must Pace the Frontier," advocating for a more measured approach to developing advanced AI models. He proposed that Anthropic provide ongoing access to external evaluators to verify safety claims. Both Sam Altman and Elon Musk expressed their agreement shortly after.
Amodei described China as "the autocratic country with by far the most advanced AI capabilities" and recommended that the U.S. continue to limit exports of sophisticated chips to China while simultaneously encouraging cooperation on global safety measures. In response, China's Foreign Ministry deemed his essay unproductive, with state media labeling it a "Cold War playbook" aimed at containing China.
President Donald Trump has distanced himself from calls for a slowdown in AI development. Following Amodei's essay, Trump dismissed warnings about AI overreach as a "hoax" associated with the "Radical Left" and accused Amodei of misconduct without presenting evidence.
Shortly after, King Charles welcomed leaders from Anthropic, OpenAI, Nvidia, and Google DeepMind to his Scottish residence for an AI safety summit that facilitated dialogue but yielded no known agreements.
The upcoming session is unlikely to result in a formal accord. It takes place just two days before Trump meets with Chinese President Xi Jinping in Washington on September 24, where discussions on AI safety and trade are reportedly on the agenda.