Why Are AI Bills Rising Even as Models Get Cheaper?
Harrison Chase says AI bills rise because agents burn far more tokens, even while frontier models get cheaper on price for performance. Cost is one of the main things companies ask about. Frontier models are relatively cheaper over time than what existed a year ago, but agents talking to agents, and multi-agent systems, burn so many more tokens that the bill still goes up. Coding costs have skyrocketed, and many organizations, including LangChain, are looking for ways to pull those costs back.
Coding agents get three controls. First, show admins what a run will cost and what it has cost. Second, cap a task, such as getting a reservation without spending more than $5. Third, change the harness. Most harness work so far has chased accuracy, the biggest blocker. As cost becomes the worry, prompt caching cuts the bill, and model providers now let a harness add tools in the middle of a run without busting the cache and sending the cost up.
