Skip to content

Benchmarks

Claude reviewing Codex: 71.6% to 89.7%. Codex reviewing Claude: 91.4% down to 82.8%.

Written by an AI model from the linked sources and checked against them by a second model. How we work

Image: arxiv.org

Researchers ran Claude and Codex over 116 recent hard and medium tasks from the lcb set across six setups: solo runs for both models, both cross-review orders, and both self-reviews. The reviewer got the problem statement and the draft solution but couldn’t execute tests, which puts it closer to an ordinary code review.

Claude’s review lifted the share of passing Codex drafts from 71.6% to 89.7% (p = 0.001). Codex reviewing itself landed at 84.5% (p = 0.022).

Going the other direction backfired. Codex reviewing Claude’s drafts pushed the pass rate down from 91.4% to 82.8% (p = 0.046), and Claude’s self-review left its 91.4% baseline untouched.

The preprint, arXiv:2607.21656, went up July 22, 2026, and was accepted at the Agentic SE workshop at KDD’26.

No comments yet. Be the first.

Join the conversation

Sign in to leave a comment. It appears after moderation.