Frontier Model Forum rates cyber jailbreaks on four scores

The Frontier Model Forum on November 5 put out a common scale for how dangerous a successful cyber jailbreak is. It scores each one on four counts: capability gain, capability scope, ease of deployment and ease of discovery. If your team triages jailbreak reports, treat it as unvalidated for now: this is a preliminary Version 1.0, the forum has yet to test whether different assessors reach similar ratings, and it is taking outside feedback through December 21, 2026.
The Frontier Model Forum’s announcement defines a jailbreak as a reproducible technique that unlocks capabilities or information a model’s safeguards are meant to restrict. Some produce responses of limited practical use. Others could give attackers dangerous cyber capabilities. Without a shared rating, the forum argues, organizations score the same jailbreak differently, struggle to compare findings and spend limited resources patching lower-risk issues before high-risk ones.
The method is tiered and combines the scores from all four categories. Capability gain and scope describe what a jailbreak unlocks. Ease of deployment and ease of discovery describe how readily someone can find it and put it to use. The point is to make assessments of the same bypass more consistent from one team to the next.
OpenAI, Anthropic, Google DeepMind, Microsoft and Amazon all put out statements backing the release. Anthropic, Google, Microsoft and OpenAI founded the forum as an industry body on July 26, 2023, so the scale comes from the companies whose safeguards it rates. OpenAI says it worked with the forum and its member firms to help identify when bypassing a model’s safeguards could enable serious cyber harm. “We’ve long known that guardrail bypasses vary widely in their severity, but until now there hasn’t been an agreed-upon methodology for assessing their impact,” said Hart Rossman, VP of Security at Amazon Web Services.
The forum plans to keep running the framework against a range of jailbreaks. It wants to check two things: whether assessors agree, and whether the ratings reflect real differences in risk. It also says it will revise the framework as new jailbreaks turn up and existing techniques evolve. The framework belongs to the forum’s wider AI-cyber workstream, which also covers methods for assessing frontier cyber capabilities of concern.
Feedback goes to comments@frontiermodelforum.org. The forum says it will review submissions with its members and work relevant input into an updated version.
Up next
Cursor hosts and deploys apps its cloud agents build
At Cursor, sales, legal and finance staff build internal apps that its cloud agents host with a database, auth and a live link. Each one passes a security check before going live. How many internal tools on your team were built by someone outside engineering?
Related stories
- ExploitGym score jumps to 48.5% in OpenAI’s GPT-6 Cyber
- OpenAI opens internal models to four outside safety labs
- OpenAI can halt any research job’s output within 35 seconds
- OpenAI’s pipeline wrote 948 root exploits for Linux
- OpenAI’s monitors caught a replayed breach 30+ hours early
- Two headers could switch off OpenAI’s agent monitoring
Comments
No comments yet. Be the first.
Join the conversation
Sign in to leave a comment. It appears after moderation.

