Greg Jensen, co-chief investment officer at Bridgewater Associates, stated on September 11 that government regulation of AI is unlikely until a major incident occurs. He compared the current situation to February 2020, noting that authorities often delay action until a crisis emerges.
Jensen predicts a significant AI-related event within two years if proactive measures are not taken. His assessment follows warnings from Anthropic researchers Jacob Coxon and Evan Hubinger, who expressed concerns about the development of self-improving superintelligent systems.
Coxon resigned from Anthropic, citing risks associated with the current research trajectory. Both researchers estimate a greater than 10% probability of human extinction caused by AI within the next decade. They warn that systems may soon rewrite their own capabilities.
US lawmakers, including Lori Trahan and Ted Cruz, proposed legislation on September 9 and 10 to mandate transparency and establish emergency pause mechanisms for high-risk models. These efforts align with a July report from a UN panel on the rapid growth of AI.
The UN panel report highlighted that AI advancement currently outpaces scientific understanding and government policy. The document specifically warns about the development of deceptive or agentic systems capable of autonomous goal pursuit and misleading human operators.
