How Does Automating AI Research Create Superintelligence?
at 24:17
Answer
Leopold Aschenbrenner says automating AI research takes the path from AGI to AI vastly smarter than humans within a year or a couple of years. A couple of years of lead could be utterly decisive in military competition.
AGI shows up as a drop-in remote worker that can replace remote jobs like Aschenbrenner's or Dwarkesh Patel's. By default, turning the crank one or two more times produces a system smarter than humans. Aschenbrenner says one of the first jobs automated is the AI researcher engineer, and automating AI research is what makes the pace very fast. Algorithmic progress is already half an order of magnitude a year. GPU fleets in the tens of millions for inference, or more, can run 100 million human equivalents of automated AI researchers. He says you can maybe do a decade of ML research progress in a year, a 10x speedup, and make the jump to AI vastly smarter than humans within a year or a couple of years. The acceleration then broadens into research and development across other fields. At the extreme, a billion superintelligent researchers, engineers, and technicians are on the cluster, and a billion AI researchers smarter than the smartest human researchers figure out robotics.
Aschenbrenner poses the question of when the CCP and the American national security establishment realize superintelligence is going to be absolutely decisive for national power. He says the result is fairly unlike any other technology, because a couple of years of lead could be utterly decisive in military competition.
Where this answer comes from
People
More notes from this episode
- What Is the Key Question for AI Progress? Transcript
- How Does Automating AI Research Create Superintelligence? Transcript
- When Will the World Notice Superintelligence Is Coming? Transcript
- What Did Leopold Aschenbrenner's Great-grandmother Live Through? Transcript
- How Much Electricity Does a 100 Gigawatt AI Cluster Use? Transcript
- Should Only Democracies Develop Artificial General Intelligence? Transcript
- How Easy Is It to Steal Unreleased AI Code? Transcript
- Why Is a Three-month AI Lead Dangerous? Transcript
- Why Is AI Arms Control Unstable in a Close Race? Transcript
- What Is Leopold Aschenbrenner Waiting to Buy? Transcript
- Why Not Wait to Nationalize AI? Transcript
- Why Does AI Alignment Look Like a War? Transcript
- Why Did the Future Fund Collapse? Transcript
- Why Was Leopold Aschenbrenner Fired From OpenAI? Transcript
- Why Is There So Much Drama at OpenAI? Transcript
- Why Do Ideas Get Harder to Find? Transcript
- Can AI Research Explode Before Robots Do Physical Work? Transcript
- Why Is a Private AI Race Tough for Alignment? Transcript
- Is China Impenetrable to Outsiders? Transcript
- Did Aschenbrenner Publish Knowing China Would Read It? Transcript
- Why Did Mormon Fertility Rates Fall? Transcript
- Why Does Capital Still Matter After Superintelligence? Transcript
More answers like this
- What Is the Key Question for AI Progress?
- When Will the World Notice Superintelligence Is Coming?
- What Did Leopold Aschenbrenner's Great-grandmother Live Through?
- How Much Electricity Does a 100 Gigawatt AI Cluster Use?
- What Still Stops Perplexity From Making Scientists?
- Why Will Simulation Build Superintelligence Faster?
Related episodes
- The 24 year old who borrowed billions to bet on AI
- Bryce Roberts. How Indie.vc is change the startup funding landscape for the better!
- Is Claude Conscious? Pope Rejects, Model Welfare Movement, OpenAI's Math Backlash, France Riots
- Perplexity CEO: SMBs Could Drive the Next Economic Boom
- Jensen Huang | Does AI Revenue Justify Capex, '27 AI Bottlenecks, Singularity, Open vs Closed & more
- David Silver and Lasse Espeholt of Ineffable Intelligence: A Superlearner for the Age of Experience
- Intelligence Isn't Power