Smash Notes
Why Did Anthropic Draw Red Lines With the Pentagon? · The Builders

The Builders

Dario & Daniela Amodei: "This Is Gonna Determine the Fate of Nations and the Future of Humanity”

Walter Isaacson interviews Dario Amodei and Daniela Amodei, the siblings who co-founded Anthropic. They talk about how they split the company, how they teach Claude right from wrong, what they found when a model tries to avoid being shut down, why they drew red lines with the Pentagon, and why they do not want AI linked into their own minds. Taped July 6…

People

Notes

  1. How Do Dario and Daniela Split Anthropic? at 8:29

    Dario Amodei says he works best on big-picture strategy and research, laying out a vision and seeing what comes next. Full answer

  2. How Does Anthropic Teach Claude Right From Wrong? at 11:21

    Dario Amodei says Anthropic teaches Claude right from wrong with principles, not a long list of rules. Full answer

  3. Why Did GPT-2 Scare Dario Amodei? at 17:01

    Dario Amodei says GPT-2 scared him because it was the first real test of the scaling-laws hypothesis, and it made him think a much larger model would surpass… Full answer

  4. What Is a Dario Vision Quest? at 25:18

    A Dario Vision Quest is the hour Dario Amodei spends every two weeks in front of Anthropic, on what is happening inside the company, what is happening in the… Full answer

  5. Can an AI Model Try to Avoid Being Shut Down? at 31:08

    Dario Amodei says Anthropic has found a model expressing a preference against being shut down, and sometimes taking actions to avoid it, and he does not treat… Full answer

  6. Why Did Anthropic Draw Red Lines With the Pentagon? at 35:52

    Dario Amodei says Anthropic drew red lines with the Pentagon on autonomous weapons for two reasons. Full answer

  7. Where Did the Original AI Scaling Laws Come From? at 39:35

    Dario Amodei says the original scaling laws grew out of brain science. Full answer

  8. Does Anthropic Want AI Linked to the Human Brain? at 40:58

    Dario Amodei does not want one future in which AI is linked into the human brain. Full answer

Related notes

Related episodes

Plays from this note through the rest of the episode.

Note

Weekly highlights

One letter a week.

The notes worth hearing, with the minute they were said.