Smash Notes

Back to The AI Race Has a Leaderboard | Arena CEO Anastasios Angelopoulos, with Anastasios Angelopoulos.

Why Is a Chinese Model Number One on Arena's Web Leaderboard?

Anastasios Angelopoulos says a Chinese model is number one on Arena's web development leaderboard because Chinese labs are doing more than distilling American models. If they are number one and America is number two, distillation cannot be the whole story. Something else is pushing the frontier past the American labs.

Web development is where most software developers work, and that is where most of the economic value is coming from. The result is a phase shift between closed and open models that the industry has not understood. Chinese scientists are showing intelligence and creativity that Americans are not fully appreciating, and more frontier models are on the way. The shift is the start of a flippening between American and Chinese models.

On open models alone, the closest American model is number 10, with nine Chinese models above it, and is probably not even in the top 10 anymore. American open source is way behind.

Transcript

The AI Race Has a Leaderboard | Arena CEO Anastasios Angelopoulos ·

Grit

More from this episode

  1. What Does Arena's Leaderboard Measure?Anastasios Angelopoulos says Arena's leaderboard measures the utility models give real users, not a benchmark a researcher wrote down.
  2. Why Did American Companies Skip Free Frontier Models?Anastasios Angelopoulos says American companies largely skipped giving frontier models away, because spending $5 billion to train one and then releasing it…
  3. How Fast Did Arena Reach a Hundred Million in Revenue?Anastasios Angelopoulos says the evaluation product Arena sells to labs scaled to over a hundred million in revenue in eight months.
  4. Why Do People Problems Take More Time at Arena?Anastasios Angelopoulos loves the chief executive role at Arena because it puts him with people from every kind of work, and because the job is to deal with…
  5. What Happens to Money When Labor Splits From Capital?Joubin Mirzadegan says the real question is what happens to money once labor splits from capital.
  6. Is One Model Provider Enough for Arena?Anastasios Angelopoulos says Arena sucks with only one model provider. With two providers, Arena is barely making it.
  7. How Long Did Anastasios Angelopoulos's Wife Cry After Her Father Died?Anastasios Angelopoulos says his wife cried every day for many months after her father died suddenly in Serbia, then every two days maybe six months later…
  8. Did Arena Favor Closed Models Over Open Ones?Anastasios Angelopoulos says Arena has always been fair to everybody. A coalition of MIT and Stanford looked like a reputable source.
  9. What Does Grit Mean When the Mission Comes First?Anastasios Angelopoulos thinks of grit as people who never give up. Day in and day out they come in with their nose to the grindstone.

People

More answers like this

The other side

More with Joubin Mirzadegan

Related episodes

Plays from this note through the rest of the episode.

Weekly highlights

One letter a week.

The notes worth hearing, with the minute they were said.