How Does Google Allocate Compute for AI?
Sundar Pichai says Google's ground rule is to invest in enough compute to stay at the AI frontier, and that priority is non-negotiable. In 2015 he told the company to be AI first, so AI runs across search, cloud, and Waymo. Google DeepMind gets cutting-edge compute access for research and frontier model development before other plans.
Each business works from its own long-range plan. The cloud team brings projections, demand signals, and committed contracts, and those signals shape a long-term compute path. Google builds its own compute and its own data centers. Lead times are long, so the compute on hand today comes from decisions he made in 2024. Google and other companies are short, and people wish they had two times the compute they planned. Planning covers what the company will need two to three years out.
A customer asking now for compute in 2027 is incredibly difficult to serve. Google leased some short-term compute last year to help customers. Alex Kantrowitz cites Andy Jassy, via Ben Horowitz, that computers are sold out until 2028, and Pichai says the industry is on similar timelines. Selling compute to outside customers still lets Google scale supply and test it across more uses.
Google CEO Sundar Pichai: AI’s Infinite Possibilities, Compute Scarcity Dilemmas, Future AI Products ·
From the transcript
Look, I think we are... the ground zero for us is making sure we are investing in the compute that's needed to be at the AI frontier. So that is You know, in 2015, I said the company to be AI first. So AI is that key horizontal ingredient across everything we do, all the way from search to cloud to Waymo to everything we do. So I think that is ground zero for us, making sure both for research and developing the models that we have enough compute needed.
Beyond that, look, we have these independent businesses which each have their own long range plans. And so they're using those long range plans to project forward and we plan for compute for all of them. And so the cloud team, they have a business and they have a projection and they have demand signals, they've committed contracts. So with that help, we can plan on a long term compute trajectory for them.