Smash Notes

Back to The Missing Infrastructure for AI Agents: Documents | Reducto’s Adit Abraham, with Adit Abraham & Jennifer Li.

Why Won't the Big Model Labs Solve Document Parsing?

Jennifer Li asks why the big model labs, already focused on knowledge work and on vision, will not simply solve document parsing. Adit Abraham says this work is tangential to intelligence. Reducto is not competing with the labs on reasoning quality, and the range of problems runs deeper than one model. A PDF can contain a folder of other PDFs. Rendering a Microsoft Word file faithfully still lacks good open-source tools, which is why LibreOffice often falls short.

He believes the labs are in an arms race to create superintelligence, and that document infrastructure is what makes that useful. Focus is the other advantage. A vision encoder for ChatGPT has to take a selfie and turn it into a Studio Ghibli image. Reducto can constrain the domain and be exceptional on that narrower set of tests. At the volume customers process, cost and latency matter as much as accuracy, and he says they can be orders of magnitude more aggressive on price than a frontier model at a comparable accuracy.

Transcript

The Missing Infrastructure for AI Agents: Documents | Reducto’s Adit Abraham ·

From the transcript

And they'll start with things like scheme optimization as like a first order problem. But really, we want to get to a point where people can apply their context effectively. Maybe on the point of building the chat duty plugin, like given the big model labs are also focused on knowledge work and they're also always improving the capability of their own models to be good at multimodality vision as well.

Like, why do you think this is not a problem that they will solve where it requires independent company like Reducto to really focus on it? Yeah. A lot of the work that we do is kind of tangential to intelligence. Like, we're not trying to compete with the labs on reasoning quality.

And I think one of the things that's underappreciated is how deep the range of problems gets. Like, even after probably looking at more PDFs than most humans, I still find corner cases that we didn't expect. Within PDFs, you can have folders of PDFs that contain other PDFs. If you think of even rendering a Microsoft Word file, you'll find that there aren't good open source tools to be able to represent that faithfully.

See in transcript

a16z

More from this episode

  1. How Does Reducto Read a Messy Document?Adit Abraham breaks document reading into a few epochs, ending with Reducto R1, one unified model that reads a page from end to end.
  2. Why Do Document Mistakes Compound Across a Dozen Files?Adit Abraham says a loan packet is more than reading the page.
  3. Why Did Coding Tools Reach a Billion in Revenue First?Adit Abraham says coding tools reached a billion dollars in annual revenue while professional-services AI has not, even though healthcare, insurance, legal…
  4. Do Frontier Models Silently Drop Facts From Long Documents?Adit Abraham says frontier models were more precise than many specialized document parsers on a long-extraction benchmark: when they pulled a fact, it was…
  5. What Should You Check First in a Document Benchmark?Adit Abraham says the first thing to check is whether the distribution of data matches the work you want done.
  6. Can Agents Do Healthcare Work Without Reliable Document Parsing?Jennifer Li asks how accuracy changes whether customers will trust an agent with their documents.

People

More answers like this

Related episodes

Plays from this note through the rest of the episode.

Weekly highlights

One letter a week.

The notes worth hearing, with the minute they were said.