Existential risk from AI is the concern that very advanced AI could cause a catastrophe on the scale of human extinction, and that reducing that risk should be a global priority.
In plain words
Some AI scientists and other public figures argue that future AI systems could be misused, built in a reckless race, or slip out of human control as they grow more capable. Many have signed a one-sentence statement calling extinction risk from AI a global priority, alongside pandemics and nuclear war. The Center for AI Safety, which published it, calls for more safety research, safety regulation and international coordination.
A quick example
Imagine an AI assistant that could give someone with no training the directions to make a chemical weapon. The Center for AI Safety lists this kind of malicious use as one of four main routes to catastrophe, alongside an AI race, accidents inside AI companies and losing control of rogue AI.
Where you'll meet it
- AI safety research agendas.
- Calls for AI safety rules and international coordination.
Related
Sources
- DocsStatement on AI Risk, Center for AI Safety · read 29 Sept 2026
- DocsAn Overview of Catastrophic AI Risks, Center for AI Safety · read 29 Sept 2026
Checked by WhatIsAI against the sources above · 29 Sept 2026. Spotted an error? Report it.