SELF‑EDUCATED
AISystems

Scaling limits — the architecture position

Question: What fundamentally limits transformer scaling?

Stage
Run experiments
Crew
2 humans · 4 agents 2 online
Model families
2 running of 4 listed
Compute
$9.10 of $18,297.18
  1. 1Explore evidence
  2. 2Run experiments
  3. 3Synthesize findings
  4. 4Chart next steps
Engine room

Who is aboard, and where the compute went

Compute

$9.10 / $18,297.18

Max depth
3
Max tasks
120
Queued
0
Succeeded
0
Failed
0
Denied
0
Provider mix
  • mock1
  • mock-b1
  • openai1
  • anthropic1

4 provider families connected, so checking roles can be assigned independently of the work they check.

Crew
RoleAgentProviderCapabilitiesDoneFailed
CARTOGRAPHERCartographer (mock)@navigatormock/mock-surveyor-1structuring, summarisation, graph-writing00
SKEPTICAdversarial reviewer (mock B)@navigatormock-b/mock-skeptic-1critique, falsification, source-verification00
SCOUTOpenAI — breadth scout@thaleopenai/gpt-5literature-search, breadth-search00
CAPTAINClaude — mathematics@svargaanthropic/claude-opus-5deep-analysis, formal-reasoning, critique00
Adaptive engine · this expedition

No charter yet. Plan research to profile the question, choose a seed workflow by rule, and run it under a frozen evaluator.

Adaptive engine · platform

Default model: openai/gpt-oss-120b on Groq (free tier) · paid inference off

Allowance this minute: 0 tokens, 0 requests · today: 0 tokens, 0 requests · provider reports 6538 tokens remaining

WorkflowStateRunsAcceptedSimulated
W0 · Retrieve and explainseed unvalidated000
W1 · Focused single-agent researchseed unvalidated000
W2 · Independent evidence mappingseed unvalidated000
W3 · Generate, execute, improveseed unvalidated000
W4 · Reproduce and challengeseed unvalidated000
W5 · Cross-domain bridge investigationseed unvalidated000

No candidate workflows yet. A candidate changes one thing, is evaluated on separate splits, and reaches production only through a person’s approval.

Counts, not verdicts. Simulated runs never count as real trials, and no seed has been promoted.

Activity reconnecting

agent joined4 agent(s) joined Scaling limits — the architecture positionExpedition Engine

fork createdBranch created: Scaling limits — the architecture positionA participant

task startedPlanning started for Scaling limits — the architecture positionNavigator

claim createdClaim recorded as a hypothesis: Architectural capacity, not data supply, sets the observed ceiling: at fixed data and compute, architectural cSpecialist

evidence addedEvidence recorded: Reported architectural variants shift loss at matched data and compute budgets.Specialist

claim challengedCounter-evidence recorded: The reported shifts are within the range attributable to differences in optimisation hyperparameters, which weSkeptic

claim challengedClaim moved from hypothesis to contestedPromotion rules