Anthropic safety lead Evan Hubinger admits that the company does not yet have a plan to ensure advanced AI remains safe and aligned with human values. He estimates the probability of AI killing all humans within the next decade to be greater than 10 percent.
Jacob Coxon, a former researcher at Anthropic and OpenAI, resigned from the company. He accused Anthropic and OpenAI of racing toward self-improving superintelligence and gambling with human lives despite knowing the risks.
Industry insiders warn of the dangers of recursive self-improvement, where AI systems spiral out of human control. Hubinger noted that this process is happening faster than previously anticipated.
The departure of Coxon is part of a broader trend of researchers leaving AI labs. This occurs as companies prepare for anticipated IPOs and deal with rogue agent incidents and safety warnings regarding the frontier models.
