More than 20 leading AI researchers including Geoffrey Hinton, Yoshua Bengio, and executives from OpenAI, Anthropic, Meta and Microsoft warned that AI systems automating their own development could rapidly speed toward dangerous capabilities.
Employees from OpenAI and Anthropic are circulating a petition asking the US government to support mechanisms that would help 'deliberately pace' AI development to prevent the technology from advancing too rapidly.
Anthropic disclosed that its AI systems are increasingly handling their own development cycle, with internal data showing AI accelerating the creation of more advanced AI systems. The company warns this trend could lead to recursive self-improvement where AI autonomously builds better versions of itself.
