Why Is There So Much Drama at OpenAI?
at 2:42:48
Answer
Leopold Aschenbrenner says the drama at OpenAI comes from a real belief that OpenAI is building AGI, then a failure to take the implications seriously or keep the commitments that belief produced.
There would be a lot less drama if OpenAI claimed only to be building ChatGPT or business software. The AGI claim is not for marketing. A report about raising $7 trillion for chips only makes sense if OpenAI really believes in AGI. Aschenbrenner says the technology will be incredibly powerful for good and for bad. National security follows from that power: protecting secrets from the CCP, and whether America or a Middle Eastern dictator controls the core AGI infrastructure. OpenAI committed 20% of compute to super alignment, a long-term safety research effort. The commitment was public and was used to recruit people, because a new product would always feel more urgent than long-term safety research. OpenAI did not keep the commitment, and something more urgent than long-term safety research always won. When Aschenbrenner raised security issues, he was told security was the number one priority. When serious resources, trade-offs, or basic measures were required, security was not prioritized.
Aschenbrenner says cognitive dissonance and unreliability cause the drama.
Where this answer comes from
People
More notes from this episode
- What Is the Key Question for AI Progress? Transcript
- How Does Automating AI Research Create Superintelligence? Transcript
- When Will the World Notice Superintelligence Is Coming? Transcript
- What Did Leopold Aschenbrenner's Great-grandmother Live Through? Transcript
- How Much Electricity Does a 100 Gigawatt AI Cluster Use? Transcript
- Should Only Democracies Develop Artificial General Intelligence? Transcript
- How Easy Is It to Steal Unreleased AI Code? Transcript
- Why Is a Three-month AI Lead Dangerous? Transcript
- Why Is AI Arms Control Unstable in a Close Race? Transcript
- What Is Leopold Aschenbrenner Waiting to Buy? Transcript
- Why Not Wait to Nationalize AI? Transcript
- Why Does AI Alignment Look Like a War? Transcript
- Why Did the Future Fund Collapse? Transcript
- Why Was Leopold Aschenbrenner Fired From OpenAI? Transcript
- Why Is There So Much Drama at OpenAI? Transcript
- Why Do Ideas Get Harder to Find? Transcript
- Can AI Research Explode Before Robots Do Physical Work? Transcript
- Why Is a Private AI Race Tough for Alignment? Transcript
- Is China Impenetrable to Outsiders? Transcript
- Did Aschenbrenner Publish Knowing China Would Read It? Transcript
- Why Did Mormon Fertility Rates Fall? Transcript
- Why Does Capital Still Matter After Superintelligence? Transcript
More answers like this
- Why Was Leopold Aschenbrenner Fired From OpenAI?
- Why Do Ideas Get Harder to Find?
- Why Did the Future Fund Collapse?
- Can AI Research Explode Before Robots Do Physical Work?
- Would an OpenAI Collapse Pop the Economy?
- Is OpenAI and Anthropic's Chip Revenue Share Falling?
Related episodes
- The 24 year old who borrowed billions to bet on AI
- Bryce Roberts. How Indie.vc is change the startup funding landscape for the better!
- Is Claude Conscious? Pope Rejects, Model Welfare Movement, OpenAI's Math Backlash, France Riots
- Perplexity CEO: SMBs Could Drive the Next Economic Boom
- Jensen Huang | Does AI Revenue Justify Capex, '27 AI Bottlenecks, Singularity, Open vs Closed & more
- David Silver and Lasse Espeholt of Ineffable Intelligence: A Superlearner for the Age of Experience
- Intelligence Isn't Power