Why Are AI Token Prices Falling?
Ethan Mollick says AI token prices face real downward pressure because a huge move for token efficiency is underway and costs will decrease even as more compute comes online. Lower cost means AI does more stuff for less money in a very short period of time, so long-term token costs do not worry him.
A chart from Andreessen Horowitz compares the price of compute with the price of tokens. Compute has stayed steady and risen a little, while the price of tokens is falling dramatically. Alex Kantrowitz calls the drop the most deflationary technology he can remember in the price paid for the technology. Use is still rising because agent-style work requires more tokens, and a Fable class model can call a Haiku class model to do work and organize work for lower costs. The token-cost concern will go the way of vibe coding and RAG.
This AI Expert Argues We're Underestimating AI's Productivity Impact — With Ethan Mollick ·
From the transcript
No one could breathe in London. There's bad stuff that happens along the way. There's worker unrest. We don't know what happens. We have to cushion against the downsides. Let's end with a couple of, one kind of random thing, and then I want to just run a couple of your tweets by you. Yes, please. And get you to comment on it. There's a great chart from Andreessen Horowitz talking about the price of compute versus the price of tokens.
And the price of compute has stayed steady and risen a little bit, but the price of tokens is just falling dramatically. I mean, this is the most deflationary technology in terms of the price that you pay for it.
That I can remember. Yes. What do you think the impact is of the fact that AI token prices are falling so dramatically? So, I mean, it's kind of looping back to what we said at the very beginning. You were kind of pushing me about token costs. And I'm like, I'm not that worried about token costs long term. This is why, right? We're using more tokens, not just Javen's paradox, but also because...