Why Won't the Big Model Labs Solve Document Parsing?
Jennifer Li asks why the big model labs, already focused on knowledge work and on vision, will not simply solve document parsing. Adit Abraham says this work is tangential to intelligence. Reducto is not competing with the labs on reasoning quality, and the range of problems runs deeper than one model. A PDF can contain a folder of other PDFs. Rendering a Microsoft Word file faithfully still lacks good open-source tools, which is why LibreOffice often falls short.
He believes the labs are in an arms race to create superintelligence, and that document infrastructure is what makes that useful. Focus is the other advantage. A vision encoder for ChatGPT has to take a selfie and turn it into a Studio Ghibli image. Reducto can constrain the domain and be exceptional on that narrower set of tests. At the volume customers process, cost and latency matter as much as accuracy, and he says they can be orders of magnitude more aggressive on price than a frontier model at a comparable accuracy.
The Missing Infrastructure for AI Agents: Documents | Reducto’s Adit Abraham ·
From the transcript
And they'll start with things like scheme optimization as like a first order problem. But really, we want to get to a point where people can apply their context effectively. Maybe on the point of building the chat duty plugin, like given the big model labs are also focused on knowledge work and they're also always improving the capability of their own models to be good at multimodality vision as well.
Like, why do you think this is not a problem that they will solve where it requires independent company like Reducto to really focus on it? Yeah. A lot of the work that we do is kind of tangential to intelligence. Like, we're not trying to compete with the labs on reasoning quality.
And I think one of the things that's underappreciated is how deep the range of problems gets. Like, even after probably looking at more PDFs than most humans, I still find corner cases that we didn't expect. Within PDFs, you can have folders of PDFs that contain other PDFs. If you think of even rendering a Microsoft Word file, you'll find that there aren't good open source tools to be able to represent that faithfully.