Back to Muse Wonder: Zuckerberg and Wang's $100B AI, with Mark Zuckerberg & Alexandr Wang.
What Is Muse Wonder?
Alexandr Wang says Muse Wonder is a new class of model at the frontier, and the lab has been working toward it since the start. A pre-train does not jump to the biggest cluster. The team climbs a ladder, training models about four or five times bigger, then repeats that. Muse Spark came from the first pre-train, done in December at the end of last year. That model is not that big, and the team still built a lot of capability into it. Wonder is the next class and significantly bigger. The target is the best personal and professional agentic model, with very good memory and the ability to persist through complicated tasks.
The time between each bigger class should now start to compress, at Meta. Wang says Meta was not happy with the trajectory of Llama 4 and rebuilt the whole team over the last year and a half. The team had to train different tiers of models to reach this one. From here, the work is pushing the frontier rather than catching up to it.