# 🔬ESM: The Bitter Lesson is Coming for Proteins - Alex Rives, BioHub

Page: https://stenobird.com/podcast/latent-space-ai-engineer/esm-the-bitter-lesson-is-coming-for-proteins-alex-rives-biohub
Text version: https://stenobird.com/podcast/latent-space-ai-engineer/esm-the-bitter-lesson-is-coming-for-proteins-alex-rives-biohub.md
Podcast: [Latent Space: The AI Engineer Podcast](https://stenobird.com/podcast/latent-space-ai-engineer)
Published: 2026-05-27T17:46:16+00:00
Episode link: https://www.latent.space/p/esmfold2
Audio file: https://api.substack.com/feed/podcast/199487836/d44a44519bdf8c14dc458f47d0972ffc.mp3
Processing state: not_requested
JSON: https://stenobird.com/v1/public/podcasts/latent-space-ai-engineer/episodes/esm-the-bitter-lesson-is-coming-for-proteins-alex-rives-biohub
Duration seconds: 4212

## Resource

Editor’s note: In our first BioHub pod with Priscilla and Mark they discussed their acquisition of EvoScale , led by Alex Rives , who is now Head of Science at BioHub. With ESM-1 they trained language models on millions of protein sequences drawn from across life, with a simple “next token” objective: predict the amino acids that have been randomly masked out, based on the context of the rest of the sequence. But they soon found that these models also learned biological structure and function, including properties the model had never been explicitly shown AND that this ability scales predictably with compute , leading to ESM2 and ESM3 . Today, Alex announced ESMFold 2, an open scientific engine to power prediction, design, and discovery across protein biology. Building on Cryo-EM data (discussed in the CZI pod), ESMFold2 reports state of the art performance on protein interactions, especially antibodies, a critical modality for therapeutics, and evidence that inference time scaling is also working across five targets in cancer and immunology . In a nod to that other famous AI x protein folding project, they are also releasing an atlas of 6.8 billion proteins, and 1.1 billion predicted structures, which you can play around with on their website . We are honored to work with them for this huge release! One of the refrains we’ve heard on the Science pod has been that protein folding, materials design, cellular biology, etc. are very different problems from Language Modeling. They definitely are. Yet Alex Rives and the ESM team at BioHub just released a preprint and model , demonstrating that vanilla BERT-like transformer models trained on sufficiently large and diverse data sets can beat specialized models like AlphaFold3 on some of the hardest protein-related problems. A…

## Actions

- request_transcript: `POST https://stenobird.com/v1/public/podcasts/latent-space-ai-engineer/episodes/esm-the-bitter-lesson-is-coming-for-proteins-alex-rives-biohub/transcription-requests` — Idempotently request low-priority transcript generation for this episode.
- read_markdown: `GET https://stenobird.com/podcast/latent-space-ai-engineer/esm-the-bitter-lesson-is-coming-for-proteins-alex-rives-biohub.md` — Read the agent-friendly Markdown representation of this episode resource.

A page view does not enqueue transcription. Agents should invoke `request_transcript` explicitly when they need this episode processed.

## Transcript

Full transcripts are not published on public pages unless there is a clear rights basis.