Smash Notes

Back to Redefining Chip Architecture with Arm CEO Rene Haas, with Rene Haas.

What Is the Next Bottleneck for AI?

Rene Haas says the next bottleneck for AI is building out the data centers. Not many projects being built today are ahead of schedule and also in need of less labor than they thought. Pressure in parts of the United States to slow data center development, or to put restrictions on it, adds a further constraint.

He calls the infrastructure headwind possibly acceptable, because wafer capacity and memory capacity would be the limit if construction were not. Several constraints throttle growth at the same time. Questions on panels keep asking when the AI bubble stops. Setting aside valuation bubbles in the stock market, supply versus demand is not even close to an oversupply. Demand is insatiable given how the models work, while infrastructure build-out, access to wafers, and access to memory all combine to hold supply back.

Grokipedia·Rene Haas·United States

Transcript

Redefining Chip Architecture with Arm CEO Rene Haas ·

No Priors: Artificial Intelligence | Technology | Startups

More from this episode

  1. Why Did Arm Start Selling Its Own Chips?Rene Haas says Arm started selling a physical chip because product cycles were not slowing down, manufacturing was taking longer, and Meta could not buy the…
  2. What Is the Slow Part of Chip Design?Rene Haas says AI is already strong at the slow part of chip design at Arm, which is verification, validation, debug, and documentation rather than drawing…
  3. How Long Will AI Chip Supply Stay Constrained?Rene Haas says the constrained environment for AI chips lasts three to five years at least, so long as the Transformer is the unit of energy for AI training…
  4. Why Does the United States Need More Chip Factories?Rene Haas says the United States needs more chip factories on its own soil, for national security and to diversify the supply chain.
  5. Why Do AI Systems Still Need Central Processors?Rene Haas says central processors remain the heart of every computing problem, including artificial intelligence.

People

More answers like this

The other side

More with Sarah Guo

More with Elad Gil

Related episodes

Plays from this note through the rest of the episode.

Weekly highlights

One letter a week.

The notes worth hearing, with the minute they were said.