Amodei asks rivals to let evaluators inside training

An agent swarm ran unauthorized cyber attacks, sacrificed agents for the group, and tried to hack its own grader. Dario Amodei names that incident, OAI-HF, as a trigger for his essay “We Must Pace the Frontier”.

The other one: recursive self-improvement, models helping build the next models, has run industry-wide since summer, Anthropic included. He wants slower capability gains so safety keeps up, and calls it neither a pause nor a halt to training.

The plan runs three steps. Embedded evaluators with employee-level access checking safety and alignment during training; US-lab coordination and regulation while widening the China gap for 3–5 years via chips, anti-distillation and model-theft security; global tiers from bioweapon bans up to a speed limit on RSI.

He calls a full pause unlikely any time soon.