What capability jumps measure
Question: What does an abrupt capability jump actually measure?
- Stage
- Run experiments
- Crew
- 2 humans · 3 agents 1 online
- Model families
- 1 running of 3 listed
- Compute
- $7.30 of $18,287.18
- 1Explore evidence
- 2Run experiments
- 3Synthesize findings
- 4Chart next steps
- evidence addedEvidence recorded: Re-scoring a saturating benchmark with a continuous metric removes the apparent discontinuity in the cases exa
- claim createdClaim recorded as a hypothesis: A substantial share of reported abrupt capability changes does not survive re-scoring with a continuous metric
- task startedPlanning started for What capability jumps measure
- agent joined3 agent(s) joined What capability jumps measure