# Bioinfohazards: Jassi Pannu on Controlling Dangerous Data from which AI Models Learn Page: https://stenobird.com/podcast/the-cognitive-revolution/bioinfohazards-jassi-pannu-on-controlling-dangerous-data-from-which-ai-models-learn Text version: https://stenobird.com/podcast/the-cognitive-revolution/bioinfohazards-jassi-pannu-on-controlling-dangerous-data-from-which-ai-models-learn.md Podcast: ["The Cognitive Revolution" | AI Builders, Researchers, and Live Player Analysis](https://stenobird.com/podcast/the-cognitive-revolution) Published: 2026-03-11T20:39:43+00:00 Episode link: https://www.cognitiverevolution.ai/bioinfohazards-jassi-pannu-on-controlling-dangerous-data-from-which-ai-models-learn/ Audio file: https://pdst.fm/e/mgln.ai/e/1113/pscrb.fm/rss/p/traffic.megaphone.fm/RINTP4770832217.mp3?updated=1773260206 Processing state: processed JSON: https://stenobird.com/v1/public/podcasts/the-cognitive-revolution/episodes/bioinfohazards-jassi-pannu-on-controlling-dangerous-data-from-which-ai-models-learn Duration seconds: 6192 ## Resource AI models are rapidly gaining the ability to bridge the gap between theoretical biology and practical pathogen engineering. Jassi Pannu proposes a Biosecurity Data Level framework to restrict dangerous functional biological data without stifling open science. ## Highlights - Main idea: Frontier AI models can provide 'uplift' by translating complex biological knowledge into actionable instructions for non-experts - Failure mode: The availability of specific mutation protocols in open literature allows for the creation of highly transmissible viruses with minimal effort - Practical takeaway: Implementing a 'Biosecurity Data Level' framework can selectively restrict dangerous sequences while preserving the benefits of open-access research - Main idea: A defense-in-depth strategy—Delay, Deter, Detect, Defend—is required to counter the speed of AI-driven biological discovery - Risk factor: The rapid growth of petabytes of unannotated sequence data creates a massive, unmonitored surface area for potential misuse ## Topics Biosecurity, Artificial Intelligence, Synthetic Biology, Pathogen Surveillance, Genomic Data, AI Safety, Bioinformatics, Protein Design ## Chapters - 1:00 — The Risk of Gain-of-Function Research: An examination of how published research on avian influenza mutations demonstrates the ease of increasing pathogen transmissibility. - 17:15 — Threat Actors and Data Security: Analyzing how AI model developers can implement security levels corresponding to the difficulty of preventing misuse. - 25:20 — The Challenge of Massive Sequence Data: Discussing the risks associated with the vast, unannotated landscape of biological sequence data currently available. - 50:00 — AI Models in Biology: A breakdown of how LLMs, bio-design tools, and foundation models like Evo act as next-token predictors for DNA and proteins. - 1:06:10 — Dangerous AI Capabilities: Evaluating the potential for AI to provide dangerous 'uplift' and the ability of agents to bypass digital safeguards. - 1:14:00 — Biosecurity Data Level Framework: Proposing a structured approach to controlling access to specific, high-risk biological datasets. - 1:38:15 — A Vision for Global Defense: The necessity of global pathogen surveillance and 'bio-radar' systems to detect emerging threats in real-time. ## Actions - request_transcript: `POST https://stenobird.com/v1/public/podcasts/the-cognitive-revolution/episodes/bioinfohazards-jassi-pannu-on-controlling-dangerous-data-from-which-ai-models-learn/transcription-requests` — Idempotently request low-priority transcript generation for this episode. - read_markdown: `GET https://stenobird.com/podcast/the-cognitive-revolution/bioinfohazards-jassi-pannu-on-controlling-dangerous-data-from-which-ai-models-learn.md` — Read the agent-friendly Markdown representation of this episode resource. A page view does not enqueue transcription. Agents should invoke `request_transcript` explicitly when they need this episode processed. ## Transcript Full transcripts are not published on public pages unless there is a clear rights basis.