Smash Notes

Back to ⚡ Building ChatGPT for Finance — Joseph Kim, OpenAI's Head of Financial Services, with Joseph Kim & Richard MacManus.

What Finance Work Can ChatGPT Actually Do Today?

Joseph Kim says the ChatGPT for financial services product OpenAI launched is a productivity tool for knowledge workers, and it assumes a human is always in the loop.

A financial analyst with a list of work for the day is meant to try ChatGPT first, the way a software engineer tries Codex. It might get the analyst 30% of the way there, or 80%, depending on the task. The person still reviews the work. That split made the product easier to explain, because the audit stays with the analyst.

The next version is meant to feel like working with a coworker rather than watching a tool. A company already knows how to check a person. At Google, a new software engineer needed readability before changing the system. In banking, where this product started, a junior analyst's work goes to an associate, then a VP, then a director or managing director. Those layers already exist to catch human mistakes, and humans make just as many mistakes as models. If a model behaves more like a person, a firm can reuse those checks.

Transcript

⚡ Building ChatGPT for Finance — Joseph Kim, OpenAI's Head of Financial Services ·

Latent Space: The AI Engineer Podcast

More from this episode

  1. Why Does ChatGPT for Finance Bundle Earnings Transcripts?Joseph Kim says ChatGPT for financial services bundles quarter earnings transcripts in-house because outside connectors failed too often.
  2. How Is OpenAI Building ChatGPT for Finance?Joseph Kim tells Richard MacManus that OpenAI built most of ChatGPT for financial services on the ChatGPT plugin architecture, and that 95% of the work is…
  3. What Finance Tasks Will OpenAI Take on in 2027?Joseph Kim says OpenAI will start to move finance work up the stack in 2027, from the task a junior analyst can do, to some of the tasks an associate can do…
  4. Why Is There No Good Eval for Finance AI?Joseph Kim says there is no good eval today for financial work, and building one that actually measures the skill is much harder than it looks.

People

More answers like this

More with Richard MacManus

Related episodes

Plays from this note through the rest of the episode.

Weekly highlights

One letter a week.

The notes worth hearing, with the minute they were said.