Smash Notes

Back to Redefining Chip Architecture with Arm CEO Rene Haas, with Rene Haas.

How Long Will AI Chip Supply Stay Constrained?

Rene Haas says the constrained environment for AI chips lasts three to five years at least, so long as the Transformer is the unit of energy for AI training and AI inference. By design, that work is very compute intensive and very memory intensive.

Young companies building AI chips are getting large funding and bringing innovative designs into an industry where capital requirements are massive. Relationships with memory vendors and substrate vendors are critical, along with access to a three nanometer line, a six nanometer line, and an advanced packaging line. The constraint does not stop in 12 months and does not stop in 24 months.

Heavy compute and memory demand drives a need for supply chain skill. People with great ideas on chip design still need a lot of other things to get access to capital and wafers.

Grokipedia·Rene Haas·Transformer

Transcript

Redefining Chip Architecture with Arm CEO Rene Haas ·

No Priors: Artificial Intelligence | Technology | Startups

More from this episode

  1. Why Did Arm Start Selling Its Own Chips?Rene Haas says Arm started selling a physical chip because product cycles were not slowing down, manufacturing was taking longer, and Meta could not buy the…
  2. What Is the Slow Part of Chip Design?Rene Haas says AI is already strong at the slow part of chip design at Arm, which is verification, validation, debug, and documentation rather than drawing…
  3. What Is the Next Bottleneck for AI?Rene Haas says the next bottleneck for AI is building out the data centers.
  4. Why Does the United States Need More Chip Factories?Rene Haas says the United States needs more chip factories on its own soil, for national security and to diversify the supply chain.
  5. Why Do AI Systems Still Need Central Processors?Rene Haas says central processors remain the heart of every computing problem, including artificial intelligence.

People

More answers like this

More with Sarah Guo

More with Elad Gil

Related episodes

Plays from this note through the rest of the episode.

Weekly highlights

One letter a week.

The notes worth hearing, with the minute they were said.