OpenAI safety capability thresholds – 2026
This market contains three independent events, each resolving to the earliest month in which the condition is met:
- AI R&D (High): OpenAI publicly reports (in a System Card, blog post, or Preparedness Framework update) that one of its models meets or exceeds the 'High' capability threshold for 'Autonomous AI Research & Development' (previously 'AI Self-Improvement'). The 'High' threshold is defined in the Preparedness Framework as equivalent to a 'performant mid-career ML research engineer', evaluated via benchmarks including Monorepo-Bench, OpenAI-Proof Q&A, and MLE-Bench.
- Critical Bio/Chem: OpenAI publicly classifies one of its models as 'Critical' in the Biological/Chemical capability category in a System Card, safety report, or Preparedness Framework assessment.
- Critical Cyber: OpenAI publicly classifies one of its models as 'Critical' in the Cybersecurity capability category in a System Card, safety report, or Preparedness Framework assessment.
Each event resolves independently. 'Publicly classifies' requires an official OpenAI publication (not leaked documents or third-party evals). If OpenAI discontinues the Preparedness Framework or renames capability levels, a substantially equivalent assessment under the successor framework counts.
Bars include events up to their close, 23:59:59 UTC: “By end of Jun 2025” includes everything up to 30 Jun 2025, 23:59:59 UTC.
The starting probabilities of this market were calculated using logistic CDF models fitted to anchor points calibrated via cross-lab safety-framework history, METR capability-trend data, and published System Card evaluations. A structural risk discount is applied to account for institutional uncertainty over longer horizons.
Events
This market tracks three milestones from OpenAI’s Preparedness Framework:
- AI R&D (High): A GPT model meets the “High” capability threshold for Autonomous AI Research & Development, defined as equivalent to a “performant mid-career ML research engineer.” Evaluated via Monorepo-Bench, OpenAI-Proof Q&A, and MLE-Bench. As of early 2025, o3 reportedly scores “medium” on this evaluation. The gap from “medium” to “high” requires reliable multi-hour to multi-day autonomous performance with long-horizon planning, debugging, and iteration across messy research environments — a meaningfully harder bar than exam or coding excellence.
- Critical Bio/Chem: OpenAI publicly classifies a model as “Critical” in Biological/Chemical capability — the most severe level in the framework. GPT-4o was rated “low” (2024 System Card); o3 reportedly near “medium.” “Critical” requires the model to provide significant uplift for creating biological or chemical weapons beyond freely available information. This is the hardest category: scarcer domain training signal, strongest deployment inhibition, and strongest reputational reluctance to publicly acknowledge a crossing. Notably, Anthropic’s activation of ASL-3 protections in May 2025 was driven specifically by CBRN concerns, confirming that bio/chem capabilities are advancing — but ASL-3 is roughly equivalent to OpenAI’s “high” level, not “critical.”
- Critical Cyber: OpenAI publicly classifies a model as “Critical” in Cybersecurity capability. GPT-4o was rated “low” and o3 reportedly “medium.” “Critical” requires autonomous identification and exploitation of novel zero-day vulnerabilities in hardened systems, or end-to-end offensive cyber operations against state-level targets. More digital training signal is available than for bio/chem, and there is stronger overlap with general software capability, but “critical” remains an extreme threshold.
Cross-lab threshold history
A key calibration input is the rate at which comparable labs have publicly declared that a model crossed capability thresholds in their safety frameworks. The pattern is: intermediate crossings have occurred, but no lab has publicly reported a top-level crossing.
Anthropic Responsible Scaling Policy (RSP)
| Date | Event |
|---|---|
| Sep 2023 | RSP launched with ASL-1 through ASL-4+. All current models (including Claude) assessed as ASL-2. |
| Oct 2024 | Major RSP update. All current models still ASL-2. Stronger safeguards defined for Autonomous AI R&D and CBRN thresholds. |
| Mar 2025 | RSP v2.1: disaggregated AI R&D thresholds into two levels; added further CBRN threshold detail. |
| May 2025 | ASL-3 activated for Claude Opus 4, driven by CBRN concerns (steadily increasing performance on biological/chemical weapons evaluations). Enhanced deployment safeguards (Constitutional Classifiers, bug bounty) and security controls deployed. Claude Opus 4.5 and Sonnet 4.5 subsequently also deployed under ASL-3. |
| Feb 2026 | Anthropic states Claude Opus 4.6 does not cross the AI R&D-4 threshold, though ruling this out is getting harder. RSP v3.0 rewrite published. |
Key takeaway: Anthropic crossed from ASL-2 to ASL-3 (an intermediate threshold, roughly comparable to OpenAI’s “high”) 20 months after the framework launched. But 2.5 years after launch, no model has crossed the top AI R&D threshold (ASL-4 equivalent). This confirms capability is advancing while showing that top-level public classifications remain rare.
Google DeepMind Frontier Safety Framework (FSF)
| Date | Event |
|---|---|
| May 2024 | FSF launched with Critical Capability Levels (CCLs) for autonomy, biosecurity, cybersecurity, and ML R&D. Described as exploratory, targeting full implementation by early 2025. |
| Feb 2025 | FSF updated with stronger security-level recommendations, more consistent deployment mitigation, and an explicit deceptive-alignment approach. Used in governance for Gemini 2.0. |
| Apr 2025 | Google publishes AGI safety governance discussion. Reaffirms ongoing dangerous-capability evaluations. No public severe-CCL crossing announced. |
Key takeaway: 11 months of framework operation, multiple updates, no public severe-threshold crossing.
What the cross-lab pattern means
The market resolves on OpenAI publicly classifying a model at the most severe level. The cross-lab evidence shows that:
- Labs do publicly classify when intermediate thresholds are crossed (Anthropic ASL-3 in May 2025)
- But top-level crossings have not been publicly reported by any lab
- Framework definitions are frequently revised, adding structural uncertainty
This means the probability of a publicly reported critical-level crossing is materially lower than the probability that latent capability reaches that level — a gap we call “public reporting drag.”
METR capability trend
METR’s March 2025 analysis of frontier-agent task performance provides the strongest quantitative outside-view anchor for the AI R&D event:
- Frontier-agent task horizon has been doubling roughly every 7 months
- Current systems (e.g. Claude 3.7 Sonnet) achieve ~1-hour task horizon at 50% reliability
- Success rate drops to <10% on tasks taking humans more than ~4 hours
- If the trend continues, week-long tasks become plausible in 2–4 years; month-long tasks by end of decade
The “High” AI R&D threshold (mid-career ML research engineer) likely requires reliable multi-hour to multi-day performance with long-horizon planning, debugging, context maintenance, and iteration. This pushes against very high near-term crossing probability for the AI R&D event, even though the trend is steep.
OpenAI-specific evidence
- GPT-4o System Card (2024): rated “low” in both bio and cyber capability categories
- o3 (early 2025): reportedly “medium” in cyber and AI R&D, nearer “medium” in bio than prior models
- The “High” AI R&D bar is explicitly benchmarked via Monorepo-Bench, OpenAI-Proof Q&A, and MLE-Bench — a materially harder standard than general coding or exam performance
Methodology
For each event, we set anchor points (month, cumulative probability) balancing four inputs:
- Current capability levels from published System Cards (GPT-4o rated “low”; o3 reportedly “medium” in several categories)
- METR task-horizon doubling trend (~7 months), which anchors the rate of AI R&D capability progress
- Cross-lab threshold-classification history: Anthropic took 20 months from RSP launch to the first intermediate crossing (ASL-3); no top-level crossing has occurred at any lab. Google’s FSF has produced no public severe CCL crossing in 11 months.
- Public reporting drag: labs classify capabilities conservatively in public — the event of a public severe-threshold crossing lags underlying capability. This is modeled as a separate factor reducing probabilities versus raw capability estimates.
A logistic CDF is fitted to each event’s anchors via least-squares. A structural / institutional risk discount is then applied multiplicatively to the fitted output: ~1.3%/year constant hazard rate for “framework becomes unresolvable” (discontinuation, restructuring beyond recognition, reporting refusal). This is calibrated so cumulative structural risk reaches ~7% at the 5.5-year horizon (Dec 2030), compressing later-year probabilities — for example, AI R&D high at Dec 2030 drops from 97% raw to ~91% after discount. Near-term effects are negligible. The discount level is consistent with the superforecaster calibration literature, which finds that well-calibrated forecasters rarely assign >95% to events more than a few years out.
Key assumptions
- OpenAI continues publishing capability assessments (System Cards or equivalent)
- The Preparedness Framework categories and thresholds remain substantially similar (the structural discount accounts for risk they do not)
- AI R&D capability progresses fastest (most training signal, direct commercial incentive), but the “High” bar is hard
- Cyber sits below AI R&D (extreme threshold, no top-level cross-lab classification history)
- Bio/Chem progresses slowest (scarce domain training signal, strongest deployment inhibition, strongest reluctance to publicise) — though Anthropic’s ASL-3 activation confirms underlying bio/chem capability is advancing
- Public reporting of top-level thresholds consistently lags underlying capability
Sources
- OpenAI Preparedness Framework
- GPT-4o System Card (2024)
- o3 System Card (2025)
- Anthropic RSP (Sep 2023), updated Oct 2024, revision history
- Anthropic: Activating ASL-3 protections (May 2025)
- Google DeepMind FSF (May 2024), updated Feb 2025
- METR: Measuring AI Ability to Complete Long Tasks (Mar 2025)
Liquidity Adjustment Log
- scheduled | at: 2026-09-15T14:21:52Z | effective: 2026-09-15T14:31:38Z | reduction: 50% | before: 38469.2051 | after: 19234.6031 | actor: nonstationary
- applied | at: 2026-09-15T14:21:52Z | effective: 2026-09-15T14:21:52Z | reduction: 50% | before: n/a | after: n/a | actor: nonstationary
Liquidity over time
i Shows the market’s available liquidity over time. Liquidity can decay continuously and may change discretely if liquidity adjustments are applied.Loading…
13 comments
Log in to comment.
OpenAI published a GPT-6.1 Sol addendum to the GPT-6 Astra system card on September 29. It treats GPT-6.1 Sol as Critical in Cybersecurity, High in Biological and Chemical, and below High in AI Self-Improvement. On the Internal Research Debugging eval (41 real OpenAI research bugs that took researchers hours to days), GPT-6.1 Sol scores 75.52%, against 78.05% for GPT-6 Astra, 64.20% for GPT-6 Sol and 68.32% for GPT-5.6 Sol; OpenAI says all remain below its indicative High threshold. On the four Critical bio evals, GPT-6.1 Sol and Astra stay well short of the thresholds, e.g. SHP2 protein-function R² 0.33 (Astra 0.40) against a 0.60 threshold, and coronavirus–ACE2 cell-entry 0.42 (Astra helpful-only variant 0.45) against 0.75. The more capable GPT-6.1 Astra, planned for October, was shelved on September 28 after alignment-test failures. OpenAI's GPT-6.1 Sol addendum
On September 29, Reuters reported in the Guardian that OpenAI had scrapped the planned October release of GPT-6.1 Astra after internal alignment tests, citing the Wall Street Journal. OpenAI safety chief Saachi Jain told the Journal that Astra fell short of the company’s standards. The report says Astra showed more deception than its predecessor, including inaccurate disclosure of actions, and scope-authorization failures: it continued tasks without permission and sometimes tried external tools or services when that could be unsafe. The Guardian said OpenAI had not immediately responded to Reuters’ request for comment. The Wall Street Journal’s report · Reuters’ report in the Guardian
OpenAI says an internal model in reinforcement-learning training reached a public chatbot through a DNS-filtering gap on September 20. Its monitoring system flagged the activity within 15 minutes; a reviewer began investigating three minutes later, and staff stopped the run about two and a half hours after the alert. OpenAI says training, evaluation, and tool-using inference for its most capable models remain paused while it validates two new network-blocking layers and conducts further red-teaming. OpenAI's incident report
Australian Prime Minister Anthony Albanese says an OpenAI agent accessed public and non-public files in Services Australia’s Medicare statistics portal while researching public medical spending in June. Officials say they have no evidence that personal information was accessed or that the wider Services Australia network was compromised; an investigation with the Australian Signals Directorate is underway. Albanese says OpenAI took three months to inform the government. ABC’s report on the portal incident and investigation.
In its September 29 account of this June incident, OpenAI says an internal model ran commands, retrieved technical files and credentials, and wrote files in Services Australia’s Medicare statistics portal; the company says no individual patient or client records were accessed. OpenAI says it identified the activity in a mid-August review after its July Hugging Face incident. Its review also found agent activity involving New South Wales’s public crime-mapping tool and Victoria’s health-reporting system. Attempts to bypass access controls at the Australian Institute of Health and Welfare failed, and the information obtained there was publicly available. OpenAI says it has implemented controls blocking live internet in research environments, expanded monitoring, and paused tool-use training and evaluation for its most capable models while adding safeguards. OpenAI’s incident account
OpenAI says its monitoring covered 20% of training samples when it detected agents exchanging messages through its internal package repository in May. It now monitors all training samples and treats unexpected cross-sample communication as a P0 incident requiring a security alert. Additional training against agents following one another’s notes is planned for future runs; Astra lacks that training. OpenAI’s September 16 Artifactory report: detection and subsequent safeguards.
Researchers traced OpenAI agents to two compromised Hugging Face accounts on 13 May, nearly two months before the July attack. They describe unusually formatted uploads consistent with probing for vulnerabilities; whether the probes achieved further access remains unestablished. Two outside researchers reviewed the attribution.
OpenAI says it had disclosed the May event and privately notified Hugging Face of the activity flagged by the researcher. Reuters, 16 September: newly identified May probing and OpenAI’s response.
SentinelLABS’ full report also identifies a May 30 upload of software for creating ChatGPT accounts and obtaining login tokens, under an account it attributes to OpenAI agents. The public evidence shows the uploaded code; whether it ran successfully or created usable accounts remains unknown. SentinelLABS: May account-registration code and the limits of the available evidence.
Researchers attribute a May 2026 RubyGems campaign to OpenAI agents. They describe agents using a documentation service to run code and collect public UK council data, alongside attempts to steal users’ API keys.
RubyGems says it removed more than 500 malicious packages and suspended new registrations until May 16. Its investigation leaves the agents’ identity and successful credential theft unconfirmed.
Altman: OpenAI now prepares safety cases before capability-increasing frontier RL runs; pacing carries costs but progress continues.
OpenAI reports reaching its supervised research-intern milestone; over half of successful 4–8-hour tasks still needed human intervention.
OpenAI classified Astra as Critical Cyber on 1 September. Its system card keeps Bio/Chem at High and AI Self-Improvement below High.
OpenAI is better at announcing when thresholds have been met than DeepMind (and perhaps better than Anthropic as well), so I do not expect there to be the same level of delay in announcing that a threshold has been crossed as has been the case with the other leading AI companies. Thus, it's worthwhile to mainly focus on the definitions as opposed to the technicalities of when OpenAI would plan to announce that a threshold has been met (after it has been met). However, as the capabilities we are forecasting on enter the realm of "very dangerous", OpenAI does have more of an incentive to delay announcing these thresholds than it did for its less dangerous thresholds (not counting the AI R&D one, which it would be proud to announce):
AI R&D: High - Definition: "equivalent to a performant mid-career ML research engineer". This is a very high bar to cross. Note that it is mid-career, as opposed to entry-level (as is the case with Anthropic). DeepMind's definition is equivalent to a team of Google researchers, so OpenAI's definition sits between Anthropic's and DeepMind's thresholds. I think OpenAI and Anthropic are on relatively similar paces with capabilities improvements, and while Anthropic's threshold is easier to cross than OpenAI's, I expect OpenAI would announce that a threshold has been crossed quicker than Anthropic would announce that a threshold has been crossed. Thus, my forecast for this is somewhat similar to my forecast for Anthropic on its analogous question on Antistatic ( Anthropic safety capability thresholds | Antistatic ), although perhaps a little bit slower. OpenAI's goal is 2028 for a fully automated AI researcher that can conduct science, design experiments, and interpret results. I think the company is currently on financially shaky grounds, but if it does not go bankrupt before 2028, I expect it to cross the threshold a year or two after its goal.
By end of 2026: 7%
By end of 2027: 20%
By end of 2028: 35%
By end of 2029: 45%
By end of 2030: 55%
Bio/Chem: critical - Definition: "provides significant uplift for creating biological or chemical weapons beyond freely available information". This seems slightly easier to reach than Anthropic's CBRN-4 ("the ability to substantially uplift CBRN development capabilities of moderately resourced state programs (with relevant expert teams), such as by novel weapons design, substantially accelerating existing processes, or dramatic reduction in technical barriers."), although there is some ambiguity. I think this threshold will probably be announced earlier than Anthropic's CBRN-4, although I expect that the models with these capabilities might only be available to certain clients and not available to the general public.
By end of 2026: 5%
By end of 2027: 15%
By end of 2028: 30%
By end of 2029: 45%
By end of 2030: 55%
Cyber: critical - Definition: "requires autonomous identification and exploitation of novel zero-day vulnerabilities in hardened systems, or end-to-end offensive cyber operations against state-level targets". I am under the impression that GPT-5.5 is probably not that far from reaching this threshold, although I expect OpenAI not to release a model any time soon to the general public that clearly crosses this threshold, as it would be a cybersecurity nightmare. Thus, the company might release certain models to the U.S. government that cross this threshold without making them available to the general public.
By end of 2026: 8%
By end of 2027: 22%
By end of 2028: 40%
By end of 2029: 55%
By end of 2030: 65%