Anthropic calls for a global pause on AI development
Anthropic executives are urging leading AI labs to slow down model development. The initiative, led by Marina Favaro and Jack Clark, cites the risk of recursive self-improvement, where systems could enhance themselves without human oversight.
The company proposes a global agreement to temporarily halt advanced model development, allowing societal institutions to adapt to technological advancements. While self-improvement has not yet been achieved, the publication notes it could happen sooner than expected.
Anthropic's current valuation stands at nearly $1 trillion, with plans for an IPO. The company's annual revenue is set to reach $50 billion by the end of the month.
Related stories
- Insiders say Anthropic oversold the rogue AI scare
- Federal Register searched comments with Alibaba's Qwen
- Anthropic's Jack Clark wants a kill switch others can check
- Amodei wants a speed limit on AI self-improvement
- UK's AI testing agency didn't get Anthropic's latest model
- Anthropic paused high-risk AI testing
Comments
No comments yet. Be the first.
Join the conversation
Sign in with Google to leave a comment. Your name and avatar come from your Google profile, and the comment appears after moderation.