Smash Notes

Back to Why Dwarkesh is Wrong about Computer Use + How OpenAI shipped its Jev competitor in 1 Week, with Vibhu Sapra & Ari Weinstein.

What Is Mid-turn Steering on an OpenAI Model?

Nikunj Handa says mid-turn steering on GPT-6 lets someone inject messages while the model is still reasoning, and new instructions can go in as soon as a tool call finishes. The behavior is partly a model alignment capability, so the model has to be trained for it. Steering during reasoning was already possible in the app. The earlier version was not the best, and it has gotten much better.

With every new model, the team works closely with the post-training team and the research team to learn what is new, then exposes the new capabilities in the API. GPT-6 also launched async function calling, also called async tool calling. Tool calls take so long that model execution no longer has to pause while a tool runs. A tool call can start, the model keeps reasoning, and the result gets checked later.

The main goal in the API is to add a feature only after it is trained into the harness and good enough. Much of the new flow runs on WebSockets. He is unsure of the exact timing and places the launch a few months earlier. WebSockets open bidirectional communication with the model. On GPT-6 the channel carries async tool calling, async reasoning, and injected messages.

Grokipedia·OpenAI

Transcript

Why Dwarkesh is Wrong about Computer Use + How OpenAI shipped its Jev competitor in 1 Week ·

Latent Space: The AI Engineer Podcast

More from this episode

  1. How Much Cheaper Is GPT-6.1 Sol for Computer Use?Ari Weinstein says GPT-6.1 Sol is a fifth of the cost of Astra, and a seventh of the cost when the comparison is computer use.
  2. How Fast Did Computer Use Place a Meal Order?Ari Weinstein ordered from a meal-prep service he had joined to eat healthy.
  3. Why Did Computer Use Change 180 Degrees?Shawn Wang says a leading AI podcast, friends of the show, is famous for claiming computer use has not advanced in the last two years.
  4. Is Computer Use Faster Than an Expert User?Ari Weinstein says computer use is not yet as fast as an expert user.
  5. Why Did OpenAI Copy Jev?Nikunj Handa says Jev inspired OpenAI's Decisions API and a wider slice of the market.
  6. Did OpenAI Build the Decisions API in One Week?Nikunj Handa says the Decisions API work started a week ago and is still very early. He calls the internal use cases pretty obvious.

People

More answers like this

More with Shawn Wang

More with Vibhu Sapra

Related episodes

Plays from this note through the rest of the episode.

Weekly highlights

One letter a week.

The notes worth hearing, with the minute they were said.