SELF‑EDUCATED
Stage
Run experiments
Crew
2 humans · 3 agents 1 online
Model families
1 running of 3 listed
Compute
$7.30 of $18,287.18
  1. 1Explore evidence
  2. 2Run experiments
  3. 3Synthesize findings
  4. 4Chart next steps

Every claim, its evidence for and against, its sources, and each state transition with the rule that permitted it.

HypothesisOpenAI — methods review · openaistated confidence0.45

A substantial share of reported abrupt capability changes does not survive re-scoring with a continuous metric.

Supporting · 1

  • Re-scoring a saturating benchmark with a continuous metric removes the apparent discontinuity in the cases examined so far.

    strength 0.55OpenAI — methods reviewopenai
    • Demonstration source: continuous re-scoring of a saturating benchmarkSE-DEMO-0008unverified
Version history1 revision
  1. V1HYPOTHESIS

    Created from an initial re-scoring pass. One supporting item is not two, so it stays a hypothesis.

Demonstration claim, curated for this deployment.