Intelligence Explosion Dynamics

Sources#

Summary#

Where Recursive Self-Improvement names the mechanism (AI building its successor) and the pathways report places it as pathway 3, this page is about the growth dynamics — the shape of the curve. The "From AGI to ASI" report distinguishes three regimes and stresses that which one obtains is poorly understood and has no historic precedent to fit:

Exponential — constant multiplicative growth rate (e.g. effective compute at ~10×/yr).
Hyperbolic (super-exponential) — the growth rate itself increases with the quantity that grows; the characteristic property is infinite growth in finite time — a singularity. First raised for AI self-improvement by Solomonoff (1985); the basis of Kurzweil's "Singularity" and many fast-takeoff scenarios (Good 1965's "intelligence explosion", Bostrom, Chalmers, Davidson).
S-curve — in natural finite systems, frictions and boundary conditions bend growth down before a singularity. For AI-research automation, "the point at which these frictions kick in is unknown."

The feedback loop#

If AI speeds up AI research, that progress yields faster/more-capable/more-numerous AI, which speeds research further — a positive feedback loop. The most dramatic dynamics (potentially hyperbolic) arise if AI research is fully automated, but weaker recursive effects are already in play (e.g. "thinking" models curating better training data; neural architecture search; AI-assisted hardware design). The report's working judgment: it is a strong assumption that hundreds of thousands to millions of artificial researchers would have negligible impact — so unless progress halts first, recursive improvement is likely at least a significant accelerant.

Four mechanisms (mapped to human evolution)#

The report maps recursive-improvement flavors onto the engines of human capability growth — AI may run each far faster:

Genetic (genotypic RSI) — improving the "blueprints": code (architectures, optimizers, harnesses) and hardware designs. Slow for humans; potentially very rapid for self-modifying AI.
Cultural (memetic RSI) — improving intellectual artifacts: automated dataset curation, synthetic data, AlphaZero-style recursive distillation, tool formation. Human cultural evolution drove the last 50,000 years; AI's could be much faster given how fast artifacts are produced/shared/consumed.
Cooperative (sociogenic RSI) — division of labor: specialization frees resources → larger collectives → further specialization. Requires cooperation; its weight for AI collectives is unclear (today's models specialize instantly via prompting). See Multi-Agent Collective Intelligence.
Data — AI curating/generating/simulating higher-quality datasets for the next generation (the AlphaZero distill-search-back-into-prior loop). The economic pressure to harvest test-time-compute returns from billions of users makes this concrete.

Formal barriers & what dampens the explosion#

Schmidhuber's Gödel machines formalize provably-optimal self-modification but require complete self-knowledge and are limited by Gödel's incompleteness (see Fundamental Limits of ASI).
Christiano's iterated amplification — capability bootstrapping while preserving alignment by recursive task decomposition.
Physical & real-time brakes — even superhuman-speed digital researchers must run experiments and wait for outcomes; anything requiring physical manipulation (better chips, wet-lab validation) can't be sped up arbitrarily. This is the embodied bottleneck and the report's main argument against an unbounded singularity. Iterated recursion also tends to plateau (diminishing returns, cf. AlphaZero) or degenerate (training on self-generated data).

The report's overall low-confidence read: a hard plateau exactly at AGI is unlikely; more probable is either a pre-AGI plateau or a relatively smooth AGI→weak-ASI transition — unless recursive improvement produces dramatic acceleration, which "cannot be ruled out" and would make the transition rapid.

A practitioner's brake: test-time compute as the pacing constraint#

Noam Brown (OpenAI, practitioner-opinion) supplies an independent, mechanism-level argument against the hyperbolic singularity — from inside a frontier lab rather than from theory. Because a model's greatest capability is unlocked only by large-scale test-time compute — runs that can take weeks or months — time itself becomes the binding constraint. "Things can only go so fast because the models need to run for long enough to actually do something really, really powerful." An overnight intelligence explosion (a breakthrough that instantly makes the model smarter, cascading in moments) is ruled out not by a compute ceiling but by the wall-clock the compute has to burn. Brown's name for the realistic shape is a "gradual takeoff": RSI accelerates the parts that parallelize and gets bottlenecked on the parts that don't — the same Amdahl's-law structure as Recursive Self-Improvement's futures — so "over time the things we're getting bottlenecked on are going to shrink" without ever going instantaneous.

This converges with the report's own embodied bottleneck (The Abstraction Barrier) from a different direction: DeepMind argues physical experiments can't be sped arbitrarily; Brown argues that even pure-inference research can't, because inference has its own irreducible duration at the frontier of capability. Both land on "time-paced, not instant."

Connections#

Recursive Self-Improvement — the mechanism; this page is its growth-dynamics complement (Anthropic's When AI builds itself is the sibling source)
AGI-to-ASI Pathways — recursive improvement is pathway 3; the report treats its dynamics as the largest forecasting uncertainty
Effective Compute Scaling — exponential compute growth is the substrate a recursive loop bends upward; data-as-RSI overlaps the data-wall counters
Multi-Agent Collective Intelligence — cooperative/sociogenic RSI is collective specialization compounding
Advantages of Digital Intelligence — high-bandwidth memetic/cultural evolution (lossless experience-sharing) is one engine of super-exponential self-improvement
The Abstraction Barrier — the embodied bottleneck converts a would-be hyperbolic loop into one paced by empirical science
Fundamental Limits of ASI — Gödel/physics/real-time limits are what bound the explosion
AI-Driven Formal Proof Search — FunSearch/AlphaEvolve are concrete algorithmic self-improvement (LLM-guided program search finding novel constructions)
Task Time-Horizon Scaling — the trendline that makes "is the curve bending?" empirically checkable
AI R&D Autonomy Evaluation (AECI) — measuring the extent of AI-R&D automation (Chan et al. 2026; Anthropic's AECI) is the empirical input a "recursive improvement scaling law" would need
Artificial Superintelligence (ASI) — whether the AGI→ASI transition is smooth or explosive is what these growth regimes decide
Large-Scale Test-Time Compute — Brown's mechanism for a time-bottlenecked (gradual, not hyperbolic) takeoff: peak capability requires long inference runs, so wall-clock binds even for pure-inference research
Noam Brown — the practitioner source for the test-time-compute pacing argument
Researcher Uplift from Code Output — supplies the labor-side coefficient for the growth question: Kwa's ~2.5× serial researcher uplift plugged into Greenblatt's R&D ≈ labor^0.55 × compute^0.45 gives ~1.77× R&D speedup today, and with compute tripling yearly both inputs grow exponentially — the semi-endogenous case for sustained (not plateauing) research-output gains
Balance-of-Power Superintelligence — the explosion scenario stated by a builder: Zuckerberg's manifesto concedes a self-improving system could "squeeze 100x or more intelligence out of each gigawatt" and command more effective compute than everyone else combined, then answers it with a compute-allocation ratio rather than a capability limit

Open Questions#

Can "recursive improvement scaling laws" be formulated — predicting self-improvement curves (and their plateau point) from early-onset datapoints?
How far can a fixed model's performance be pushed with test-time search alone, and under what conditions does recursive distillation degenerate vs. compound?
Which binds first — algorithmic ceilings, the embodied bottleneck, or compute/energy supply — determining exponential vs. hyperbolic vs. S-curve? Partially answered: RSI Growth Curves: Which Friction Binds First? — both this report and Anthropic's locate the binding constraint outside cognition (the slowest un-acceleratable step coupling the loop to reality); the embodied bottleneck re-paces rather than halts, data-wall/research-harder demote into compute, and the abstraction barrier is the one candidate fundamental blocker. Retagged #oq/now → #oq/source 2026-08-10: the candidate is named but unranked, and ranking it needs external evidence rather than further synthesis.

Sources#

From AGI to ASI — Section 2 ("Is the Singularity near?"), Section 5.3 (recursive self-improvement, four mechanisms), Section 7.1 (research agenda item 4)
Really Big Test-Time Compute in AI Changes Benchmarks, Safety and Research with OpenAI's Noam Brown — Noam Brown (No Priors, 2026-06-26), practitioner-opinion: test-time-compute dependence makes time the takeoff bottleneck; "gradual takeoff," no overnight explosion