Smash Notes

Back to The AI Race Has a Leaderboard | Arena CEO Anastasios Angelopoulos, with Anastasios Angelopoulos.

Did Arena Favor Closed Models Over Open Ones?

Anastasios Angelopoulos says Arena has always been fair to everybody. A coalition of MIT and Stanford looked like a reputable source. Digging into the analyses about Arena at the time showed the claim that the company was favoring closed source models over open source models.

The complaint came from Cohere, and Cohere was about number 70 at the time. People can say what they want about the incentives. It felt like a stab in the back from people who could have been future colleagues if he ever decided to go to Stanford.

It was another difficult experience on top of the personal challenges at the time. It was very hard for him and his wife, and it happened a few months before their wedding. They thought the wedding was going to be a sad time and that they were not going to have a good day. She rallied for the day, and they both had an awesome time. A wedding is something you only get once.

Grokipedia·Arena·Cohere

Transcript

The AI Race Has a Leaderboard | Arena CEO Anastasios Angelopoulos ·

Grit

More from this episode

  1. What Does Arena's Leaderboard Measure?Anastasios Angelopoulos says Arena's leaderboard measures the utility models give real users, not a benchmark a researcher wrote down.
  2. Why Is a Chinese Model Number One on Arena's Web Leaderboard?Anastasios Angelopoulos says a Chinese model is number one on Arena's web development leaderboard because Chinese labs are doing more than distilling American…
  3. Why Did American Companies Skip Free Frontier Models?Anastasios Angelopoulos says American companies largely skipped giving frontier models away, because spending $5 billion to train one and then releasing it…
  4. How Fast Did Arena Reach a Hundred Million in Revenue?Anastasios Angelopoulos says the evaluation product Arena sells to labs scaled to over a hundred million in revenue in eight months.
  5. Why Do People Problems Take More Time at Arena?Anastasios Angelopoulos loves the chief executive role at Arena because it puts him with people from every kind of work, and because the job is to deal with…
  6. What Happens to Money When Labor Splits From Capital?Joubin Mirzadegan says the real question is what happens to money once labor splits from capital.
  7. Is One Model Provider Enough for Arena?Anastasios Angelopoulos says Arena sucks with only one model provider. With two providers, Arena is barely making it.
  8. How Long Did Anastasios Angelopoulos's Wife Cry After Her Father Died?Anastasios Angelopoulos says his wife cried every day for many months after her father died suddenly in Serbia, then every two days maybe six months later…
  9. What Does Grit Mean When the Mission Comes First?Anastasios Angelopoulos thinks of grit as people who never give up. Day in and day out they come in with their nose to the grindstone.

People

More answers like this

More with Joubin Mirzadegan

Related episodes

Plays from this note through the rest of the episode.

Weekly highlights

One letter a week.

The notes worth hearing, with the minute they were said.