{"podcast":{"title":"The Stack Overflow Podcast","slug":"the-stack-overflow-podcast","podcast_index_feed_id":450923,"rss_url":"https://rss.art19.com/the-stack-overflow-podcast","website_url":"https://art19.com/shows/the-stack-overflow-podcast","image_url":"https://content.production.cdn.art19.com/images/f1/4b/a2/43/f14ba243-6fa1-48bc-88bb-16b5e90e01cf/9ab8462ecb3182c5303998dc1a19385c2c816946f95a9fa658457e657e3ea170cac950b4c623a4447028d0e31bb3b3e2ec62ad0b4d3fe42f5bc0419c6d811c9d.jpeg","author":"The Stack Overflow Podcast","episode_count":939,"summary":"For well over a decade, the Stack Overflow Podcast has been exploring what it means to be a developer and how the art and practice of software engineering is changing our world. From creating code to running it in production, we host important conversations and fascinating guests that will help you understand how technology is made and where it’s headed. Hosted by Ryan Donovan, the Stack Overflow Podcast is your home for all things software.","last_synced_at":null,"page_url":"https://stenobird.com/podcast/the-stack-overflow-podcast"},"episode":{"title":"How can you test your code when you don’t know what’s in it?","slug":"how-can-you-test-your-code-when-you-don-t-know-what-s-in-it","published_at":"2026-03-31T04:30:00+00:00","page_url":"https://stenobird.com/podcast/the-stack-overflow-podcast/how-can-you-test-your-code-when-you-don-t-know-what-s-in-it","show_page_url":"https://stenobird.com/podcast/the-stack-overflow-podcast","url":"https://rss.art19.com/episodes/4322d3fc-87b7-4276-abce-c4b3c3b7da8a.mp3?rss_browser=BAhJIg90cmFuc2NyaWJyBjoGRVQ%3D--952c5701c84ad333c69d5faa668f8177091704f0","audio_url":"https://rss.art19.com/episodes/4322d3fc-87b7-4276-abce-c4b3c3b7da8a.mp3?rss_browser=BAhJIg90cmFuc2NyaWJyBjoGRVQ%3D--952c5701c84ad333c69d5faa668f8177091704f0","summary":"The shift toward Model Context Protocol (MCP) and LLM-driven agents introduces non-determinism that breaks traditional software testing. This discussion explores how developers can validate agentic workflows when the sequence of tool calls is decided on the fly by an AI.","meta_description":"Explore the challenges of testing non-deterministic MCP servers and the future of software engineering in an era of LLM-generated code and agentic workflo…","key_points":["Main idea: MCP is becoming the new foundational layer for AI agents, shifting the abstraction level from LLM prompts to tool invocation","Failure mode: Relying on rigid, hard-coded workflows for AI agents defeats the purpose of the LLM's ability to decide the best path dynamically","Practical takeaway: Testing must move toward validating outcomes and bounds rather than checking specific, hand-authored code paths","Economic trade-off: AI-generated code may prioritize development velocity over performance, requiring a new pricing strategy to cover higher compute costs","Future outlook: As source code becomes a commodity, the value in engineering will shift toward data construction and managing the complexity of agentic interactions"],"chapters":[{"start_ms":60000,"title":"Guest Background","summary":"Fitz Nowlan discusses his journey from PhD research in distributed systems to leading AI architecture at SmartBear."},{"start_ms":200000,"title":"The Challenge of Non-deterministic Testing","summary":"The difficulty of testing MCP servers where the LLM decides the tool sequence on the fly, making rigid workflows impossible."},{"start_ms":470000,"title":"Prompt Engineering vs. Long-term Value","summary":"Why developers should avoid falling in love with specific prompts that may be rendered obsolete by newer, better models."},{"start_ms":755000,"title":"The Future of Unit Testing","summary":"A debate on whether traditional unit testing loses relevance when AI can effectively handle assertion-based testing."},{"start_ms":1280000,"title":"Commoditization of CRUD Apps","summary":"How AI-driven development lowers margins for basic applications and shifts the focus toward more complex engineering problems."},{"start_ms":1670000,"title":"MCP as the New Foundation","summary":"The transition from LLMs being the core focus to MCP providing the essential infrastructure for agentic tool use."}],"topics":["Model Context Protocol","AI Agents","Software Testing","LLM-driven Development","MCP Servers","Agentic Workflows","Non-determinism","Software Architecture"],"duration_seconds":1818,"processing_state":"processed","actions":[{"name":"request_transcript","method":"POST","url":"https://stenobird.com/v1/public/podcasts/the-stack-overflow-podcast/episodes/how-can-you-test-your-code-when-you-don-t-know-what-s-in-it/transcription-requests","description":"Idempotently request low-priority transcript generation for this episode."},{"name":"read_markdown","method":"GET","url":"https://stenobird.com/podcast/the-stack-overflow-podcast/how-can-you-test-your-code-when-you-don-t-know-what-s-in-it.md","description":"Read the agent-friendly Markdown representation of this episode resource."}]}}