Episode
#156 Bayesian Experimental Design & Active Learning, with Adam Foster
- Podcast
- Learning Bayesian Statistics
- Published
- Apr 25, 2026
- Duration seconds
- 4603
- Processing state
failed
Actions
POST https://stenobird.com/v1/public/podcasts/learning-bayesian-statistics/episodes/156-bayesian-experimental-design-active-learning-with-adam-foster/transcription-requests
Idempotently request low-priority transcript generation for this episode.GET https://stenobird.com/podcast/learning-bayesian-statistics/156-bayesian-experimental-design-active-learning-with-adam-foster.md
Read the agent-friendly Markdown representation of this episode resource.
Summary
Support & Resources → Support the show on Patreon → Bayesian Modeling Course (first 2 lessons free) Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work Takeaways Q: What is Bayesian experimental design and what problem does it solve? A: It's the practice of using a Bayesian model to decide how to collect data before you collect it. Most statistical thinking starts with a fixed dataset. Bayesian experimental design sits upstream -- you have control over experimental parameters (which questions to ask, which reagents to mix, which conditions to test) and you want to choose them optimally. The Bayesian angle is to ask: what new data would most reduce my current uncertainty? Q: When should you actually use Bayesian experimental design? A: When two conditions hold: you have active control over how data is collected (not just passive observation), and you have a Bayesian model whose prior predictive distribution gives a reasonable picture of what typical data might look like. It's especially valuable when data collection is expensive or irreversible -- when the "committal step" of running an experiment has real cost, it's worth doing the analysis first. Q: What is expected information gain (EIG) and why is it central to Bayesian experimental design? A: EIG is the score you assign to a candidate experimental design -- the amount of information you expect to gain about your model parameters by running an experiment with that design. You compute it by simulating datasets from your prior predictive, doing Bayesian inference on each, and averaging how much the uncertainty decreased. What's remarkable is that you can derive the same quantity from two completely different starting points -- reducing parameter uncertaint…