Why Do Ideas Get Harder to Find?
at 2:46:08
Answer
Leopold Aschenbrenner says ideas get harder to find because each next discovery takes a log-scale jump in cumulative research effort. On a log-log plot the pattern is a straight line, with log cumulative research effort on the horizontal axis and log output on the vertical axis. The first discovery is easy. Later discoveries show up only after total research effort has multiplied again.
Dwarkesh Patel cites the point Patrick Collison and others have made. Compared with 100 years ago, the world has 100 times more researchers, and progress is not happening 100 times faster. Leopold Aschenbrenner says the hundred-times figure is easy to inflate and the increase is probably at least 10 times. A 10-times rise in research effort is, for him, an extremely natural story. The same straight line fits GDP, algorithmic progress, transistors per square inch, and the price of a gigawatt of solar.
Where this answer comes from
People
More notes from this episode
- What Is the Key Question for AI Progress? Transcript
- How Does Automating AI Research Create Superintelligence? Transcript
- When Will the World Notice Superintelligence Is Coming? Transcript
- What Did Leopold Aschenbrenner's Great-grandmother Live Through? Transcript
- How Much Electricity Does a 100 Gigawatt AI Cluster Use? Transcript
- Should Only Democracies Develop Artificial General Intelligence? Transcript
- How Easy Is It to Steal Unreleased AI Code? Transcript
- Why Is a Three-month AI Lead Dangerous? Transcript
- Why Is AI Arms Control Unstable in a Close Race? Transcript
- What Is Leopold Aschenbrenner Waiting to Buy? Transcript
- Why Not Wait to Nationalize AI? Transcript
- Why Does AI Alignment Look Like a War? Transcript
- Why Did the Future Fund Collapse? Transcript
- Why Was Leopold Aschenbrenner Fired From OpenAI? Transcript
- Why Is There So Much Drama at OpenAI? Transcript
- Why Do Ideas Get Harder to Find? Transcript
- Can AI Research Explode Before Robots Do Physical Work? Transcript
- Why Is a Private AI Race Tough for Alignment? Transcript
- Is China Impenetrable to Outsiders? Transcript
- Did Aschenbrenner Publish Knowing China Would Read It? Transcript
- Why Did Mormon Fertility Rates Fall? Transcript
- Why Does Capital Still Matter After Superintelligence? Transcript
More answers like this
- Why Is There So Much Drama at OpenAI?
- Can AI Research Explode Before Robots Do Physical Work?
- Why Was Leopold Aschenbrenner Fired From OpenAI?
- Why Is a Private AI Race Tough for Alignment?
- How Did OpenAI Get So Many Math Results So Fast?
Related episodes
- The 24 year old who borrowed billions to bet on AI
- Bryce Roberts. How Indie.vc is change the startup funding landscape for the better!
- Is Claude Conscious? Pope Rejects, Model Welfare Movement, OpenAI's Math Backlash, France Riots
- Perplexity CEO: SMBs Could Drive the Next Economic Boom
- Jensen Huang | Does AI Revenue Justify Capex, '27 AI Bottlenecks, Singularity, Open vs Closed & more
- David Silver and Lasse Espeholt of Ineffable Intelligence: A Superlearner for the Age of Experience
- Intelligence Isn't Power