CORTIST / 2027 MILESTONE WATCHLIST

AI predictions you can actually check.

When will coding agents solve private professional tasks? Will robots execute reliable multi-object work? Will frontier-AI rules be enforced? Five original research candidates connect ambitious AI forecasts to observable events. Two now have separately registered official numerical vintages.

Research-draft release, 27 October 2026: five original research candidates, with two separately approved numerical forecasts (CM-003 20% and CM-004 15%) now registered; zero scored outcomes. No claim of existing calibrated forecasting intelligence.

05Researched milestone questions
2027Clear event-deadline year
00Scored outcomes (2 official forecasts locked)

Evidence Pulse 2.0 checks the published Cortist News index when JavaScript is available. The source-linked, dated research articles remain accessible through Cortist News.

OPERATIONAL RULES UPDATE / 27 OCT 2026

For the EU fine and Waymo Munich milestones, we have clarified the exact decision evidence, event window and reasons certain announcements or permits do not qualify. Both still require independent verification before a forecast can be locked.

Review the Article 101 rule · Review the Munich paid-ride rule
NEW / PRIMARY-SOURCE AUDIT · 27 OCT 2026

Every candidate has been checked against its official sources. Five important definition gates remain open; none is ready for a formal probability or scoring.

Read all five source audits and the next verification steps

Five questions worth watching

Each candidate links to an original benchmark, legal authority or operator statement. Every page spells out what would count as “yes”, what would not count, and what must be clarified before assigning a probability.

CM-001 / AI Agents

Will an AI coding agent resolve 90% of SWE-bench Pro V2 private tasks by October 2027?

Resolution target: SWE-bench Pro V2 private benchmark: at least 90% audited pass@1

Strongest because withheld tasks reduce contamination risk; not a test of general intelligence.

Deadline: 27 Oct 2027Draft · no probability
Examine rules, source evidence and exclusions →
CM-002 / AI & Robotics

Will a robot complete at least 50% of five-object LADDER tasks by October 2027?

Resolution target: Real-robot LADDER five-object sequences: at least 50% complete

Direct physical reliability test; definition not yet ready to score.

Deadline: 27 Oct 2027Draft · no probability
Examine rules, source evidence and exclusions →
CM-005 / AI Chips & Compute

Will verified AI inference performance per watt double by October 2027?

Resolution target: MLPerf Endpoints: at least 2x GPT-OSS-120B standardized throughput per watt

Chips and inference efficiency need full-system like-for-like measurement.

Deadline: 27 Oct 2027Draft · no probability
Examine rules, source evidence and exclusions →

New, dated accountability review: See all eight published provisional forecast drafts and the exact quality blockers for all five Milestones. No outcome or Brier score has been verified yet.

Our quality gates before any forecast lock

This is the strategic foundation for later calibration and accuracy measurement, not an artificial quota of predictions.

01 / Check the event

Exclude already achieved or ambiguous outcomes. Freeze benchmark splits, source versions, inclusions and exclusions.

02 / Check the evidence

Define the authoritative public result and what to do if a benchmark or official source changes.

03 / Lock before scoring

Publish an externally verifiable timestamp and one explicit probability. Preserve every later revision as a new version.

What we explicitly rejected

We do not use a saturated public software leaderboard as an apparently difficult target. Nor will we pre-register a score on OSWorld 2.1 without accounting for its independently documented scoring problems. Reliable forecasting requires stable measurement before attractive numbers.

Frequently asked questions

What are Cortist Milestones?

Short-horizon binary AI research questions, designed to be resolved against clearly specified real-world evidence. These first five are public candidate definitions and are not yet numerical predictions.

Are these milestones already official Cortist forecasts?

CM-003 and CM-004 now have separately approved 20% and 15% v1 original numeric forecasts. None has an outcome yet. The three other candidates remain unapproved.

How can a milestone be scored?

Cortist must prospectively register exact outcome criteria, a deadline, a publisher-approved frozen probability vintage and then publish evidence-based event adjudication. Only then can a proper scoring rule such as the Brier score apply.

Machine-readable, dated candidate register (v1) · Questions last researched 27 October 2026. Event conditions and cutoffs are not prospectively locked forecasts yet.