# Episode 55: From Frittatas to Production LLMs: Breakfast at SciPy

Page: https://stenobird.com/podcast/vanishing-gradients-4989163/episode-55-from-frittatas-to-production-llms-breakfast-at-scipy
Text version: https://stenobird.com/podcast/vanishing-gradients-4989163/episode-55-from-frittatas-to-production-llms-breakfast-at-scipy.md
Podcast: [Vanishing Gradients](https://stenobird.com/podcast/vanishing-gradients-4989163)
Published: 2025-08-12T15:00:00+00:00
Episode link: https://hugobowne.substack.com/p/episode-55-from-frittatas-to-production-68d
Audio file: https://api.substack.com/feed/podcast/181324513/e81eb5fa3735fd4fa7bfe0599df0e4d2.mp3
Processing state: not_requested
JSON: https://stenobird.com/v1/public/podcasts/vanishing-gradients-4989163/episodes/episode-55-from-frittatas-to-production-llms-breakfast-at-scipy
Duration seconds: 2289

## Resource

Traditional software expects 100% passing tests. In LLM-powered systems, that’s not just unrealistic — it’s a feature, not a bug. Eric Ma leads research data science in Moderna’s data science and AI group, and over breakfast at SciPy we explored why AI products break the old rules, what skills different personas bring (and miss), and how to keep systems alive after the launch hype fades. You’ll hear the clink of coffee cups, the murmur of SciPy in the background, and the occasional bite of frittata as we talk (hopefully also a feature, not a bug!) We talk through: • The three personas — and the blind spots each has when shipping AI systems • Why “perfect” tests can be a sign you’re testing the wrong thing • Development vs. production observability loops — and why you need both • How curiosity about failing data separates good builders from great ones • Ways large organizations can create space for experimentation without losing delivery focus If you want to build AI products that thrive in the messy real world, this episode will help you embrace the chaos — and make it work for you. LINKS Eric' Website ( https://ericmjl.github.io/ ) More about the workshops Eric and Hugo taught at SciPy ( https://hugobowne.substack.com/p/stress-testing-llms-evaluation-frameworks ) Upcoming Events on Luma ( https://lu.ma/calendar/cal-8ImWFDQ3IEIxNWk ) 🎓 Learn more: Hugo's course: Building LLM Applications for Data Scientists and Software Engineers ( https://maven.com/s/course/d56067f338 ) — https://maven.com/s/course/d56067f338 ($600 off early bird discount for November cohort availiable until August 16) Get full access to Vanishing Gradients at hugobowne.substack.com/subscribe

## Actions

- request_transcript: `POST https://stenobird.com/v1/public/podcasts/vanishing-gradients-4989163/episodes/episode-55-from-frittatas-to-production-llms-breakfast-at-scipy/transcription-requests` — Idempotently request low-priority transcript generation for this episode.
- read_markdown: `GET https://stenobird.com/podcast/vanishing-gradients-4989163/episode-55-from-frittatas-to-production-llms-breakfast-at-scipy.md` — Read the agent-friendly Markdown representation of this episode resource.

A page view does not enqueue transcription. Agents should invoke `request_transcript` explicitly when they need this episode processed.

## Transcript

Full transcripts are not published on public pages unless there is a clear rights basis.