Smash Notes
How Does Legora Test AI Agents Without Seeing Client Data? · Latent Space: The AI Engineer Podcast

Latent Space: The AI Engineer Podcast

Building Legal Agents When You Can't See the Data - Jacob Lauritzen, CTO of Legora

Legora can’t read a single trace of what its agent does for a lawyer. The data belongs to the law firm’s clients. How do you build and test an agent when you can’t see its work? Jacob Lauritzen is the CTO of Legora, one of the fastest-growing companies...

People

Notes

  1. How Does Legora Test a New AI Model on Legal Work? at 8:55

    Jacob Lauritzen says Legora scores a new model on a heatmap of practice areas and tasks, because a release often gets better at some legal work and worse at… Full answer

  2. Why Do Law Firms Use a Partnership Model? at 14:23

    Jacob Lauritzen says a law firm partnership exists because the only capital law firms have is human capital. Full answer

  3. Are AI Tools Replacing Junior Lawyers? at 16:52

    Jacob Lauritzen says no. Legora is not seeing paralegals and junior lawyers disappear. Full answer

  4. Why Would Law Firms Adopt AI If They Bill by the Hour? at 18:55

    Jacob Lauritzen says large firms are adopting AI because the hourly model is already under competitive pressure, not because billing by the hour rewards speed. Full answer

  5. How Quickly Do American Customers Move on Legora? at 24:29

    Jacob Lauritzen says European customers have been slower to move on Legora, while American customers move quickly and keep the work high on the agenda. Full answer

  6. How Does Legora Test AI Agents Without Seeing Client Data? at 26:25

    Jacob Lauritzen says Legora tests its agents on stand-in matters and on coarse labels, because the company cannot read a trace of what the agent did for a… Full answer

  7. Why Does Legora Have to Run on Azure? at 29:05

    Jacob Lauritzen says Legora had to host everything on Azure because client law firms already treated Microsoft as an approved vendor. Full answer

  8. How Does Legora Run a Contract Due Diligence? at 34:35

    Jacob Lauritzen says Legora Tabular Review is a spreadsheet for due diligence: one row per contract, one column per question, and every cell filled in from… Full answer

  9. Do Legora Forward Deployed Engineers See Client Data? at 44:44

    Jacob Lauritzen says no. Forward deployed engineers build the system around a client's workflows, and they still do not touch the matter data. Full answer

  10. Does Legora Offer Its Whole Product as an API? at 47:35

    Jacob Lauritzen says no. Legora is not offering the whole web app as an API. Full answer

  11. Why Did Legora Stop Trying to Stay at 20 Engineers? at 50:44

    Jacob Lauritzen says staying at 20 engineers would lose the deals. Legora is in fierce competition, and clients ask for more than a tiny team can ship. Full answer

Related notes

Related episodes

Plays from this note through the rest of the episode.

Note

Weekly highlights

One letter a week.

The notes worth hearing, with the minute they were said.