Devin’s PRs merge at 43%, Claude’s at 84%
All about: Coding agents →
Not every coding agent gets its code accepted. In a new arXiv study, Claude’s pull requests merged at 84%, roughly matching the 85% humans reach. Codex landed 74% and Devin 43%.
The authors used the AIDev dataset to track how the merge gap between agentic and human PRs moved over time, which development tasks agents get pointed at, and how that task mix shifts by quarter. The preprint went up on July 23, 2026, filed under Software Engineering.
Up next
Security teams blocked Cursor, so agents move on-prem
“1% of my engineers are responsible for 40% of my token spend,” Coder CEO Rob Whiteley told The New Stack, and his fix is Agent Relay, which runs Cursor’s agents inside customer-controlled workspaces.
Related stories
- Coding agent clears all 183 ARC-AGI-3 levels
- GPT-6 Astra designed a Codex device in under a week
- DeepSeek’s Super-agent is a design paper, not a release
- GPT-6.1 Sol jumps from 5.4% to 86.6% on COBOL migration
- Junior share of Anthropic tech hires fell from 27% to 9%
- Microsoft AI’s MAI-Base-2 trained on 16K GPUs with Muon
Comments
No comments yet. Be the first.
Join the conversation
Sign in to leave a comment. It appears after moderation.