Smash Notes

Back to Controlling Biology - Fabian Theis, Helmholtz Munich, with Fabian Theis & RJ Honicky.

Why Do Linear Baselines Still Matter for Virtual Cell Models?

Fabian Theis says linear baselines still matter because a field rushing toward a virtual cell sometimes skipped them. On the plain task of naming a cell type from a new transcriptome, some models close to the state of the art are logistic regression. CellTypist does a good job. A paper from his group about five or six years ago said, in a plain title, that deep learning is not needed for cell type prediction. The claim holds inside one organ. Across organs the task gets subtler, because cell types show up again in different organs and immune cells change with the tissue.

Early perturbation analyses used classical linear models. Around 2019 his lab introduced linear shifts inside a latent space and still compared them with simpler linear shifts. The ARC Institute ran a competition it called a virtual cell challenge. The fixed metrics were not very specific to single-cell data and could be exploited. The model crowned the winner is a flow-matching model, which he takes as a sign that some nonlinearities are needed once the exploitation is set aside. On simple setups with a few cell lines and gene knockouts, especially when the effects are subtle, fancier models sometimes overfit, so the linear baseline stays the check. For drugs he tells students that beating the mean, short of even a linear model, is the baseline to clear, and the measurements are very noisy.

Transcript

Controlling Biology - Fabian Theis, Helmholtz Munich ·

Latent Space: The AI Engineer Podcast

More from this episode

  1. What Is a Virtual Cell?Fabian Theis says a virtual cell, in the way people use the phrase, is a model that predicts how a cell would behave under all kinds of perturbations.
  2. What Is a Transcriptome?Fabian Theis calls a transcriptome the messenger RNAs each cell reads off a genome that the Human Genome Project mapped for the body and that stays pretty…
  3. What Is Perturbation Space for a Virtual Cell?Fabian Theis calls perturbation space the input space of everything that happens to a cell.
  4. What Is an Organoid?Fabian Theis says an organoid is a little piece of an organ grown in a dish.
  5. Why Did Later AlphaFold Models Learn Rotation Symmetry From Data?Fabian Theis says later AlphaFold models found rotation symmetry in the data instead of building that rule into training.
  6. How Competitive Are Startups in Germany?Fabian Theis leaves a small doubt on the exact ranking and still puts Munich, at least in continental Europe, as the prime place now for VC capital and for…
  7. How Does a Model Choose the Next Biology Experiment?Fabian Theis says a model chooses the next biology experiment by inverting a forward model.

People

More answers like this

More with RJ Honicky

More with Brandon Anderson

Related episodes

Plays from this note through the rest of the episode.

Weekly highlights

One letter a week.

The notes worth hearing, with the minute they were said.