Smash Notes

Back to #428 How Claude Shannon Worked.

How Did Claude Shannon Turn Information Into Bits?

David Senra, reading the book's account, says Claude Shannon turned information into bits by treating it as a measurable quantity. Before Shannon, information was a telegram, a photograph, a paragraph, or a song, and there was little sense of it as an idea fitted for hard science, just as objects had inertia before Newton. After Shannon, information was entirely abstracted into bits. Information theory was his recognition that all information, whatever the source, the sender, the recipient, or the meaning, could be efficiently represented by a sequence of bits. He treated the bit as information's fundamental unit.

Senra thinks the paper was published in 1948. He says it introduced ideas behind the modern digital world and is widely regarded as one of the most influential scientific papers of the 20th century. It laid a theoretical foundation for the internet, data compression, error correcting codes, digital telecommunications, modern computing, and much of today's AI infrastructure.

Transcript

#428 How Claude Shannon Worked ·

Founders

More from this episode

  1. How Did Claude Shannon Simplify Hard Problems?David Senra, reading the chapter Constructive Dissatisfaction in Jimmy Soni and Rob Goodman's A Mind at Play, says Claude Shannon simplified hard problems…
  2. How Did Claude Shannon Build the Digital World?David Senra, reading the book's account, says Claude Shannon muted the world, built his own, and in turn built the foundation of the digital world.
  3. Why Did Claude Shannon Ignore Scientific Celebrity?David Senra, reading the book's account, says Claude Shannon ignored scientific celebrity because indifference was how he worked.
  4. What Was the Differential Analyzer?David Senra, reading the book's account, says the differential analyzer was one of the world's first large-scale analog computers: a brain the size of a room…
  5. Why Did a Flight Instructor Try to Ground Claude Shannon?David Senra, reading the book's account, says Claude Shannon's genius was obvious to everybody around him in college, enough that a flight instructor tried to…
  6. Why Was John von Neumann Guarded on His Deathbed?David Senra, reading the book's account, says uniformed military personnel watched John von Neumann around the clock on his deathbed because the government…
  7. Why Did Claude Shannon Build Toys and Machines?David Senra, reading the book's account, says Claude Shannon built toys and machines because he drew no line between them and his math.
  8. What Return Did Claude Shannon Earn on Stocks?David Senra, reading Fortune's Formula, says Claude Shannon's stock portfolio returned 28% a year from the late 1950s through 1986.

People

More answers like this

More with David Senra

Related episodes

Plays from this note through the rest of the episode.

Weekly highlights

One letter a week.

The notes worth hearing, with the minute they were said.