Smash Notes

Back to Biohub: The Future of Biology is Open-Source with Co-Founders Mark Zuckerberg, Priscilla Chan, and Head of Science Alex Rives, with Priscilla Chan & Mark Zuckerberg.

How Does Biohub's Protein Model Design Antibodies?

Alex Rives says Biohub's new ESM fold model designs single-chain antibodies on a computer, and a lab test of 96 proteins found nanomolar binders, the level needed for therapeutic activity, even though the team did not build the model for antibodies.

About a week before the conversation, the team announced ESM fold as an open system for scientific discovery in protein biology. It is a world model with a language-model base, trained on billions of protein sequences, and it learns emergent representations of protein biology. It predicts atomic-resolution protein structure fast enough to illustrate a Pareto optimal frontier of speed and accuracy. The team folded over 1.1 billion proteins, predicted their structures, and identified features connecting them through mechanistic interpretability. ESM fold hits state of the art across structure prediction benchmarks, especially on protein-protein interactions and protein-antibody interactions, which matter for therapeutic design.

Searching the world model runs hundreds of thousands of trajectories digitally. The team then synthesizes 96 proteins on a 96-well plate and tests them in a short lab cycle. The tests found nanomolar binders. A general-purpose model of protein biology can do that design work. The same system maps vast stretches of the protein universe and moves from digital design to binders with therapeutic-level activity in one small experimental cycle.

Grokipedia·Priscilla Chan

Transcript

Biohub: The Future of Biology is Open-Source with Co-Founders Mark Zuckerberg, Priscilla Chan, and Head of Science Alex Rives ·

From the transcript

Maybe I could say something about our most recent launch, because I think it also kind of illustrates some of this. Yeah, so, you know, because I guess it was just a week ago, about now, so we announced the new ESM fold. And so this is basically...

an open system for scientific discovery in protein biology. It's a world model of protein biology that's been trained. It's a language model base. So it's been trained on billions of protein sequences, kind of learns these emergent representations of protein biology. And then we can use it to make predictions of atomic resolution protein structure.

And we can use it to... And it's really fast. So it's blazing fast. So it's kind of...

you know, illustrating this Pareto optimal frontier of kind of speed and accuracy in structure prediction. And so this allows us to kind of characterize, you know, really vast kind of stretches of the protein universe. So we folded over 1.1 billion proteins and predicted their structures and and identified kind of features connecting all of them through mechanistic interpretability.

See in transcript

No Priors: Artificial Intelligence | Technology | Startups

More from this episode

  1. Why Does Biohub Build Tools Instead of Cures?Priscilla Chan says Biohub's goal is to build tools that accelerate whole scientific fields so the field can collectively cure disease, and Biohub is not the…
  2. How Does Biohub Model Biology From Proteins Up?Mark Zuckerberg says each layer of biology ends up qualitatively different, so Biohub builds models from proteins upward instead of jumping straight to cells.
  3. Why Does Biohub Release Biology Models as Open Source?Mark Zuckerberg says Biohub releases its biology models as open source so more scientists get the tools sooner, which he expects will move the field faster…
  4. Why Does Biohub Study Systems Instead of One Disease?Mark Zuckerberg says Biohub studies systems such as inflammation and the immune system, rather than one disease, so other groups can use the tools on specific…
  5. Why Was Baby KJ's Therapy Aimed at the Liver?Priscilla Chan says baby KJ's disease was chosen because the therapy had to reach his liver, where a product could be delivered.
  6. Can a Model Predict Where a Drug Will Bind?Alex Rives says a model that can simulate where a drug distributes and binds across the body is the beginning of a solution to toxicity.
  7. How Would Biohub's Virtual Cell Link Genes to a Phenotype?Alex Rives says Biohub's virtual cell would model each level of biological complexity and connect the proteomic layer, the genetic layer, and the…

People

More answers like this

The other side

More with Sarah Guo

More with Elad Gil

Related episodes

Plays from this note through the rest of the episode.

Weekly highlights

One letter a week.

The notes worth hearing, with the minute they were said.