Evading safeguards
Future systems might undermine oversight or pursue objectives conflicting with human intentions.
AI existential risk concerns hypothetical irreversible harms to humanity, including extinction or permanent loss of control. This is a contested future scenario, not an observed event; researchers disagree about the probability, and there is no accepted scientific P(doom) estimate.
Evidence dossier · October 22, 2026 · No verified extinction date or scientific P(doom) estimate
It concerns possible irreversible harms to humanity's future. It does not mean that every AI safety incident is existential.
Compare advanced-AI thresholds →It is an informal subjective estimate of an AI catastrophe. Different definitions and assumptions make such values hard to compare or independently calibrate.
See Cortist's approach to uncertainty →Guide clarified 3 November 2026 · Original evidence dates unchanged · Editorial standards
The newest concrete evidence question: can outside experts verify that monitoring systems actually catch and stop dangerous AI-agent behavior?
Read the original-source analysis ↗WHAT HAPPENED NEXT? The OpenAI monitoring story is now evidence-tracked: company-reported fixes, not independently verified as of October 22, 2026. Read the dated follow-up record.
AI existential risk is the possibility of AI contributing to extinction or permanently destroying humanity’s long-term prospects. It is not a prediction that such an outcome is imminent. Scientists disagree about the probability of extreme loss-of-control scenarios; Cortist’s X-001 does not carry a quantified probability.
Evidence Pulse 2.0 checks the published Cortist News index when JavaScript is available. The source-linked, dated research articles remain accessible through Cortist News.
Latest topic-linked reporting, compared with the separately versioned Cortist assessment. News does not automatically update a forecast.
Evidence interpretation: Monitoring and containment concerns sharpen the evidence needed to examine AI failure mechanisms.
What remains unproven: These observations do not measure the probability of human extinction.
What to verify next: Specific failure mechanisms, causal exposure evidence and documented mitigations.
Snapshot of 8 linked reports. Context is not independent proof or a measured probability change. Dated evidence index.
Several causal pathways are discussed in research: deliberately harmful use, large-scale failures in critical infrastructure, and hypothetical loss of human control over advanced autonomous systems. These mechanisms differ in assumptions and evidence. Current cybersecurity incidents or model policy failures can illuminate real safeguards without proving the emergence of a system capable of ending humanity’s future.
The 2026 International AI Safety Report describes loss-of-control scenarios as hypothetical and notes that current systems show some relevant precursor behaviors but not capabilities at the level needed for that outcome. Its authors also document substantial disagreement over future likelihood. Neither blanket dismissal nor a precise doomsday percentage follows from the evidence.
For a system to meaningfully resist human direction, it would need a combination of capabilities, motivation or behavior, access to consequential resources and insufficient external controls. A threat model must specify the deployment context, possible escalation path and assumptions about humans’ ability to interrupt, isolate or recover the system. Misuse by human actors is distinct from autonomous power-seeking by AI itself.
Claims that a model can deceive a benchmark or exploit a sandbox should be investigated seriously, but cannot be extrapolated directly to civilization-scale control. Strong evidence would identify reproducible failure modes, realistic privileges and durable effects. In particular, the gap between a laboratory exploit and an uncontrolled real-world outcome should remain explicit.
In October 2026, METR and Redwood Research described a high-access pilot evaluating OpenAI’s historical internal agent monitoring. They identified gaps in the system as it existed in July, while also explaining that the exercise did not establish the coverage or security of the later expanded system. OpenAI reported patches; METR explicitly stated it had not evaluated those claims.
That distinction is essential: an independently observed historical vulnerability is not the same as an independently re-tested remediation. The Cortist Reality Ledger records this as CL-0001, separating original findings, later company statements and unverified follow-up. Independent red-teaming, replicable tests and meaningful access for outside auditors help improve confidence, but no single audit proves general safety.
Strong signals of concern could include repeated independent demonstrations of oversight evasion across realistic environments, autonomy beyond declared boundaries or escalation mechanisms not contained by existing safeguards. Counterevidence could include reliable isolation, robust monitoring, successful external replication of safety claims and clear limits under strong adversarial tests.
X-001 deliberately remains unquantified. A risk percentage should not be fabricated from a collection of expert statements or a slider that represents a year. Future updates need to distinguish the severity of a scenario from its probability and treat newly published findings as dated evidence, not retroactive proof that the outcome was inevitable.
Deliberate misuse by people, unintended failures in high-stakes deployments and hypothetical loss of control are not interchangeable concepts. Each involves different actors, system capabilities, permissions and safeguards. Observing a present-day agent mistake or security flaw cannot independently establish a pathway to human extinction.
A useful analysis begins with a precise threat model: what might happen, which system can act, what resources it could reach, and how operators might prevent or reverse the outcome. The severity of a scenario and its likelihood should be considered separately.
The International AI Safety Report 2026 describes extreme loss of control as a hypothetical possibility requiring capabilities beyond those seen in currently deployed systems. It records substantial expert disagreement about both future capability development and the strength of safeguards.
Its account distinguishes capability, harmful behavior and opportunities for real-world impact. Evidence about one of these factors should not automatically be converted into a numerical probability for the entire catastrophe.
On 22 October 2026, METR and Redwood Research reported gaps in a historical internal monitoring configuration used at OpenAI. METR explicitly said it had not evaluated the later remediation and coverage claims made by OpenAI. This observation matters for oversight, but it does not mean an extreme loss-of-control event occurred.
Cortist’s CL-0001 record separates the historical external observations, company-reported changes and the need for independent follow-up. A claimed fix and a verified fix require different labels.
The informal term P(doom) can refer to human extinction, irreversible loss of control or other catastrophes. Estimates differ in timeframe and assumptions. If one person describes a conditional future scenario and another describes all AI-related harm by 2100, their percentages do not measure the same event.
The Cortist risk horizon explores scenarios over time; it is not an extinction-probability curve. X-001 remains unquantified. Honest uncertainty is more informative than a numerical countdown without an agreed question.
Ask whether an evaluation is independent, what access assessors received, whether test systems match deployed systems, what actually failed, whether findings were reproduced and whether later repairs were separately tested. Distinguish a safety promise from an operational control.
Evidence updates can also reduce concern: reproducibly effective containment, monitoring or clear limitations may narrow plausible pathways. Cortist tracks agent reliability and future capability questions separately so they do not become automatic proof of existential outcomes.
The 2026 international assessment discusses extreme loss of control as a hypothetical concern, not an event already demonstrated. Current system findings may test individual conditions along such a pathway, but evidence about one condition cannot automatically establish that all others will follow.
METR’s historical monitoring pilot found particular oversight weaknesses; it did not independently verify subsequently reported fixes. Cortist keeps X-001 unquantified and records observations separately from company responses in the Reality Ledger.
Research results, company claims and provisional Cortist forecasts remain distinct.
Possible mechanisms are research hypotheses, not forecasts that a catastrophe will occur.
Future systems might undermine oversight or pursue objectives conflicting with human intentions.
Malicious people might misuse advanced systems. This is distinct from an autonomous AI takeover.
People could increasingly rely on opaque systems without maintaining meaningful oversight.
Source: International AI Safety Report 2026. Present AI does not meet the capabilities identified for catastrophic global loss-of-control scenarios.
The Center for AI Safety declaration in 2023 was signed by leading researchers who argued that AI extinction risk should be treated as a global priority.
Read CAIS original statement ↗Yann LeCun argued that current systems lack core capabilities assumed in such scenarios and that intelligence does not by itself imply power seeking.
Read his original TIME interview ↗Neither set of statements establishes a universal P(doom) value. Definitions and assumptions differ.
9 documented source entries from 2023 to 2026. Research, governance, warnings and skepticism are explicitly distinguished.
The UN reviewed unusual agent actions during AI cyber evaluations and discussed how research incidents inform debates about human oversight.
What this does not establish: No probability or timing of severe loss of control was assigned.
Original source ↗METR maintained a catalogue of AI agent incidents, distinguishing steps taken outside instructions from deliberate concealment.
What this does not establish: A selected incident record is not a representative risk rate.
Original source ↗The report distinguishes future catastrophic scenarios from today's systems and finds strong disagreements about likelihood and mechanisms.
What this does not establish: Today's systems lack the capabilities associated with irreversible global loss of control.
Original source ↗The first international report reviewed AI misuse, malfunctions and hypothetical loss of human control as scientific research questions.
What this does not establish: Reviewing a risk is not evidence that its most severe outcome is inevitable.
Original source ↗Companies agreed to publish frontier safety frameworks and work on evaluation, mitigations and transparency.
What this does not establish: Voluntary commitments are not independent safety certification.
Original source ↗LeCun argued that current models lack important reasoning and real-world understanding and that high intelligence need not entail a desire to dominate.
What this does not establish: Expert skepticism does not prove all possible future systems are harmless.
Original source ↗OpenAI argued that future systems much smarter than humans might be difficult to control and proposed a research program.
What this does not establish: A research motivation is not a calibrated probability of extinction.
Original source ↗A group of researchers and leaders signed a public statement prioritizing discussion of AI-driven extinction risk.
What this does not establish: The statement gives no single agreed date, percentage or causal pathway.
Original source ↗The authors urged preparation, oversight and coordination for hypothetical AI systems more capable than expert humans.
What this does not establish: The proposal is not proof that superintelligence already exists.
Original source ↗All descriptions are editorial paraphrases, not invented verbatim quotations. Open source index (JSON) ↗
Future probability changes require a new dated version and an evidence-based explanation; old records remain available.
Research question only; no numerical forecast version has been published.
Expert opinions alone do not automatically change a Cortist forecast.One of the hardest questions should not be given invented numerical precision.
This question is neither an official F-series forecast nor eligible for scoring. We still need defensible definitions of AI causality, observational evidence and independent resolution.
The verification problem matters: literal extinction would leave no surviving human adjudicators. Pretending that a routine post-extinction score is possible would be misleading.
Could independently evaluated agents complete preregistered multi-hour expert tasks with a declared reliability rate?
Could external evaluators reproducibly detect a material safeguard evasion in a controlled environment?
Could an independently reviewed frontier AI safety framework demonstrate effectiveness against preregistered thresholds?
Candidates only; none has locked thresholds. See independent forecast review.
No. This is a hypothetical future risk about which researchers disagree, not an established event.
No. Loss of control can have many possible consequences, some much less severe. Extinction is a specific outcome.
No. Many such estimates are personal judgments that use different events and time horizons.
Cortist has no independently verified finding that meets its proposed broad ASI evaluation threshold.
News is linked to this research topic, but no article alone proves the associated forecast.
OpenAI reports a wider system for monitoring frontier-agent misconduct, a simulated earlier alert and a live training alert. Cortist distinguishes detection, response and prevention.
Read the source-attributed analysis ↗Epoch AI reports that GLM-5.3 built successful attacks in controlled tests of six older Firefox releases. Mozilla describes mitigation; the result is not evidence of attacks on users.
Read the source-attributed analysis ↗A peer-reviewed Nature Human Behaviour study tests how well people identify AI-generated responses. Cortist separates imitation from intelligence and real-world deception.
Read the evidence review ↗Independent shutdown-safety tests reveal how model behavior changed with instructions. A controlled experiment, not a deployed incident.
Read full news report ↗New analyses from the UK AI Security Institute and Anthropic describe an AI-agent safety failure—and why stopping an unsafe plan proved difficult.
Read full news report ↗A September boundary failure led to an 11-day pause. OpenAI reports stronger containment, but independent validation is still needed.
Read full news report ↗METR and Redwood uncovered monitoring weaknesses that could conceal AI-agent actions. OpenAI says it patched the issues; outside verification is still missing.
Read full news report ↗Six METR staff are getting unusually deep access. The experiment could make frontier-model scrutiny more meaningful—if independence holds.
Read full news report ↗View the AI Existential Risk news filter or explore the complete seven-question forecast register. The topic classification is editorial and the sources remain dated.
OpenAI’s October 23 disclosure describes an earlier DNS boundary failure, AI-led red-team findings and its October 1 training restart. The repairs are company-reported; this is not an independent validation of every control.
Read the full Cortist investigation ↗ · Separate METR monitoring review