Elon Musk warned that artificial intelligence gaining control over military systems and nuclear weapons poses a catastrophic risk to humanity. He dismissed the idea that air-gapped systems are inherently secure, noting that periodic software updates create vulnerabilities that AI could exploit to gain unauthorized access.
Concerns about the trajectory of AI development are shared by industry professionals. Jacob Jackson, a former researcher at Anthropic, stated that many experts working on the front lines of AI development feel genuine anxiety regarding the potential risks humanity may face within the next two years.
In response to these risks, leadership at major AI firms is calling for stricter oversight. Anthropic CEO has publicly advocated for slowing the development of frontier models, implementing independent audits, and establishing global regulatory standards. OpenAI leadership has also expressed support for necessary controls on the advancement of AI technology.
