How Fast Did Arena Reach a Hundred Million in Revenue?

Anastasios Angelopoulos says the evaluation product Arena sells to labs scaled to over a hundred million in revenue in eight months. The public leaderboard never touches money.

Arena runs the public leaderboard as a charity and values every model on it for free, which also works as marketing. The paid work happens while models are still in development. A lab can show up with about 50 checkpoints in a week and ask whether they are good at front end work, full stack work, or tool calls, and where they need to improve. Arena evaluates the checkpoints on data that represents real usage and hands the results back as an insights dashboard. The company had about 15 to 20 people eight months ago and now has about 75 or 80.

The next step is putting an arena inside every business in America and every business globally. Companies could use their own data to see which models are best for them, for their users, and for their employees, and how to save money. The hard part is the trade-off between performance and cost. Performance is not speed the way a CPU can be hardware benchmarked. It is whether people are getting their jobs done better and whether satisfaction, measured like CSAT, shows up in the organic traces generated inside the company.