How Much Do Coding Agents Speed Up Engineers?
Diogo Almeida estimates coding agents speed up engineering by 20% to 40% on average, with error bars for long-term effects like skill degradation and tech debt. He treats the average gain as a decent but small boost.
The number depends on the use case and on the skill of the user. Side effects are the bad part, so the gain also depends on whether side effects can be isolated in a way that stays legible. In some use cases the speed-up is kind of like an infinite percent, because the work would never get done otherwise. In other use cases the agents are as bad as coding the thing by hand.
A decent but small average boost is the consensus he has seen in the field right now.
Ep 97: Jev Creator on Decision Models, Benchmark Fatigue & Why the Labs Missed It ·
From the transcript
OK, I will say I have error bars on this, because I think that there's long-term effects like skill degradation and tech debt and stuff like this. So my estimates are in the 20% to 40% speed-up range. But again, it really depends on the use case. And it also depends on the skill of the user and if you can, because the side effects are the bad thing, if you can isolate the side effects in a way that those are very legible.
So depending on the use case, for some, it's kind of like an infinite percent speed up. You would do things you would never, you can do things you can never do otherwise. For others, they are like just so bad that they're as bad as like coding the thing by hand. I would guess on average, it's like a decent but small boost. And I believe that is the consensus that I've seen in the field right now.