Back to The American Startup Taking On China’s AI Models, with Misha Laskin.
Why Should AI Intelligence Get Cheaper?
Misha Laskin says the amount of intelligence available per watt will keep increasing, so the cost of intelligence should be driven down as far as possible in order to use more of it. The pattern is a classic Jevons paradox. Intelligence should not be seen as a premium product like an Apple iPhone. Intelligence is more like electricity and water, and it should be a commodity.
The whole system around intelligence is expensive, and there will still be some margin, but margins on inference today are very healthy for both closed model inference and open model inference. On whether very expensive training will bring subsidies like the support federal, state, and local governments give utilities such as electricity and water, the market is too early to tell. Something like that subsidy is only a possibility in some future.
The American Startup Taking On China’s AI Models ·
From the transcript
And so the amount of intelligence you'll get per watt is gonna keep increasing.
And so you wanna drive intelligence, the cost of intelligence down as much as possible so you can use it more, right? There's like this classic Jevons paradox kind of thing. So all this to say that intelligence should not be seen like a premium product, like an Apple, you know, like iPhone or something. Intelligence is more like electricity and water, and it should be a commodity.
The whole system around intelligence is expensive. They'll have some margin, but the margins today on inference are actually very healthy for both closed and open model inference. On the inference, though, because—and so I think the utility point is really interesting—