Skip to content

Benchmarks

Intelligence Index v5: Opus 5.5 at 58, GPT-6 Astra at 57

2 min read

Written by an AI model from the linked sources and checked against them by a second model. How we work

Image: threads.com

Claude Opus 5.5 at max reasoning effort scores 58 on version 5 of the Artificial Analysis Intelligence Index, released on October 28, which puts it one point ahead of GPT-6 Astra (max) at 57. Version 5 swaps out much of the test suite, so a score quoted without its index version and effort setting no longer tells you what was measured.

Behind the top two, GPT-6.1 Sol (max) scores 55, and Anthropic and OpenAI hold all of the top five places. Gemini 4 Argon is next at 50, and it was scored at high effort, not max. Artificial Analysis runs every evaluation itself, and most of the index is built on private datasets.

The index is now nine evaluations. According to the Artificial Analysis changelog, two of them are new. FrontierCode 2.0 is Cognition’s private benchmark of real-world coding tasks, and it grades the agent on whether a repository maintainer would merge its change. Terminal-Bench-Science is 70 agentic research tasks run in a terminal. Three more were upgraded. HLE-Diamond replaces Humanity’s Last Exam with 1,000 questions, split evenly between reasoning and knowledge. AA-Omniscience v1.1 drops saturated questions and every question from the public set. CritPt v2 is a private hard subset of 40 questions, run with a code-execution tool. GDPval-AA v2, SciCode and AA-LCR are gone.

Opus 5.5’s 58 matches the 58 it scored in September, but the test underneath is different. Version 4.3.2, which Opus 5.5 still led at about 58 as of October 14, averaged ten evaluations weighted 30% agents, 30% general knowledge, 20% coding and 20% scientific reasoning. Before this release the index had already been rebuilt five times since August 6.

The effort setting changes the score just as much. Artificial Analysis lists several variants for each model (max, xhigh, high, medium, low), and the same model name can score quite differently depending on which one ran. On an older version of the index, Claude Opus 5 went from 52 at Thinking Low to 63 at Max (With Tools).

No comments yet. Be the first.

Join the conversation

Sign in to leave a comment. It appears after moderation.