Smash Notes

Back to The world of voice AI, with Mati Staniszewski of ElevenLabs, with Mati Staniszewski.

Why Are ElevenLabs Voice Models Cheaper to Train?

Mati Staniszewski says ElevenLabs voice models are definitely cheaper to train than language models and image and video models because they are significantly smaller. A leading-edge voice model has a few billion to the low tens of billions of parameters. Leading language models run in the hundreds of billions of parameters, with smaller variations used at lower scale.

Capital spending is still high. ElevenLabs recently raised half a billion at an 11 billion valuation to keep building the best models and hire the best researchers. His co-founder leads the audio work. Inference cost follows usage. Text-to-speech is usually charged per text token. A voice agent or transcription is charged per minute, and per-minute work is the bigger share. Business customers sign an annual agreement, and a bigger spend brings a bigger discount.

A new model is offered at cost so customers can try the best quality. It costs ElevenLabs more to run than any previous generation, quality is higher, and the price stays competitive. Early on, reliability might not be there, and people do not yet know what the model makes possible. Wide distribution lets customers show what is possible and shows ElevenLabs what to improve.

Grokipedia·ElevenLabs·Mati Staniszewski

Transcript

The world of voice AI, with Mati Staniszewski of ElevenLabs ·

From the transcript

Yeah, definitely cheaper than the LMN and image video models. Significantly smaller models. OK, so the models are smaller. Smaller. What's the parameter count for a leading edge voice model? few billion to low tens of billion parameter models. And for context, I think the, I mean, kind of like, you know, CPUs moved away eventually from gigahertz as like the metric as they moved to more cores.

I think we've mostly moved away from just raw parameter count, but I think the leading edge LLMs are in the hundreds of billions of parameters. I think the leading ones, yes, but of course, you know, you have the variations that you will use at lower scale. So CapEx is still pretty high. We've, of course, raised recently half a billion at 11 billion valuation.

See in transcript

Cheeky Pint

More from this episode

  1. How Does an Audio Model Turn Text Into Speech?Mati Staniszewski says a modern audio model predicts the next sound from the sounds and the text around it, rather than copying a human throat.
  2. How Did ElevenLabs Make Synthetic Speech Sound Human?Mati Staniszewski says ElevenLabs voices sound human because the models were trained on how speech is delivered, not only on the words.
  3. Why Can't an AI Audiobook Sell on Audible?Mati Staniszewski says an AI audiobook cannot be sold on Audible.
  4. Why Is Voice AI Harder Than Text?Mati Staniszewski says voice has not passed a conversational Turing test, even though text models did that a long time ago.
  5. Why Do Sales Leads Share More on a Voice Call?Mati Staniszewski saw people registering interest with ElevenLabs share more once they could speak with an agent instead of only finishing the written form.
  6. Can People Who Lost Their Voice Speak Again?Mati Staniszewski says people who lost a voice can get speech back, and he calls that the most important result of the work.
  7. What Is ElevenLabs Annual Recurring Revenue?Mati Staniszewski says the most recently announced ElevenLabs revenue figure was 350 million at the end of 2025, and the latest quarter added 100 million in…
  8. How Does Ukraine's Diia Service Use Voice?Mati Staniszewski says Ukraine's Diia service became a way to reach citizens during the war, and ElevenLabs added voice so people could use it by speaking.
  9. Why Do High-agency People Win From AI?Mati Staniszewski says high-agency people are the ones who win from advances in AI, and that inside organizations low-agency people will lose out.

People

More answers like this

More with John Collison

Related episodes

Plays from this note through the rest of the episode.

Weekly highlights

One letter a week.

The notes worth hearing, with the minute they were said.