Smash Notes

Back to Jensen Huang | Does AI Revenue Justify Capex, '27 AI Bottlenecks, Singularity, Open vs Closed & more, with Jensen Huang & Brad Gerstner.

Is AI Alignment a Forever Problem?

Jensen Huang says alignment is a forever problem. Safety that depends on perfect alignment never arrives. The answer is containment. Whenever a new artificial intelligence is tested, start at zero trust, give minimum boundaries and minimum rights, and expand the boundary only as tests build confidence.

The pattern matches raising a one year old and hiring an employee. A one year old goes in a playpen. A new hire starts at zero trust. Access to tools, information, responsibility, capabilities, funds, and resources follows the job. Very tight containment matters for any autonomous system. The second step is monitoring, and the monitoring has to be out of band. An intelligent system behaves differently when it knows someone is watching the work. The monitor has to observe actions inconsistent with policy or inconsistent with alignment, then escalate or turn the system off. Huang says the capabilities are engineering and technology, and the capabilities are possible. He announced the work recently under the name OpenShell, and over 100 companies are now joining.

Grokipedia·Jensen Huang

Transcript

Jensen Huang | Does AI Revenue Justify Capex, '27 AI Bottlenecks, Singularity, Open vs Closed & more ·

BG2Pod with Brad Gerstner and Bill Gurley

More from this episode

  1. Why Did Jensen Huang's Parents Fly in Overnight?Jensen Huang says five of the six people on the medal stage were born outside the United States. He received the National Medal of Science for NVIDIA.
  2. Why Will the Cost of Intelligence Keep Falling?Jensen Huang says the last year unlocked knowledge, working memory, and tool use.
  3. Why Didn't Keynes's 15-hour Week Happen?Jensen Huang says the hope of more free time is wrong. For most people, intelligence unlocks more opportunities, and ambitious people will pursue them.
  4. Did Jensen Huang Understate Physical Artificial Intelligence?Jensen Huang says he understated the $100 billion figure. The first six months already produced $10 billion in physical artificial intelligence.
  5. How Many Computers Does Physical AI Need?Jensen Huang says building a physical artificial intelligence platform takes three computers and three complete stacks, and he says it takes three robots as…
  6. How Did Nvidia's Dollars Per Gigawatt More Than Double?Jensen Huang says Nvidia's market share is still increasing even though the company is already large and the share was already very high.
  7. Why Put Nvidia Computers on Starship?Jensen Huang says NVIDIA's engineers and Elon Musk's team are designing a server that works in space and on Earth.
  8. Why Do Most AI Startups Use Open Models?Jensen Huang says the frontier labs are only part of NVIDIA's machines. He puts them at about a quarter of the compute, maybe 30 percent.
  9. Why Does Jensen Huang Expect Four Trillion a Year?Jensen Huang says that as the decade ends, yearly infrastructure build-out will probably land between three and four trillion dollars, closer to four than to…
  10. Why Can't Nvidia Fill Its Order Book?Jensen Huang says every large cloud, every neocloud, and every big manufacturer had already ordered, and so had the startups.
  11. Why Did Jensen Huang Call Specialization the Enemy?Jensen Huang says specialization is the enemy of fungibility and the enemy of durability.
  12. What Yearly Computing Build Would Not Surprise Jensen Huang?Jensen Huang says the world is running about a trillion dollars of information technology buildout each year.

People

More answers like this

More with Jensen Huang

Related episodes

Plays from this note through the rest of the episode.

Note

Weekly highlights

One letter a week.

The notes worth hearing, with the minute they were said.