Anthropic releases AI proficiency report

The company analyzed 9830 conversations with Claude to understand how users interact with the model. The study uses a 4D framework that identifies 24 skills for effective AI collaboration, 11 of which can be measured in chat logs.

The key finding: an iterative approach where users refine answers and develop ideas correlates with higher-quality output. These users are 5.6x more likely to question the AI’s logic and 4x more likely to notice missing context.

However, when generating final artifacts, users become less critical. The likelihood of fact-checking drops by 3.7 percentage points, and critical analysis of arguments falls by 3.1 points. Anthropic advises against taking results at face value and recommends always asking follow-up questions.