Episode
Episode 59: Patterns and Anti-Patterns For Building with AI
- Podcast
- Vanishing Gradients
- Published
- Sep 23, 2025
- Duration seconds
- 2857
- Processing state
not_requested
Actions
POST https://stenobird.com/v1/public/podcasts/vanishing-gradients-4989163/episodes/episode-59-patterns-and-anti-patterns-for-building-with-ai/transcription-requests
Idempotently request low-priority transcript generation for this episode.GET https://stenobird.com/podcast/vanishing-gradients-4989163/episode-59-patterns-and-anti-patterns-for-building-with-ai.md
Read the agent-friendly Markdown representation of this episode resource.
Summary
John Berryman (Arcturus Labs; early GitHub Copilot engineer; co-author of Relevant Search and Prompt Engineering for LLMs) has spent years figuring out what makes AI applications actually work in production. In this episode, he shares the “seven deadly sins” of LLM development — and the practical fixes that keep projects from stalling. From context management to retrieval debugging, John explains the patterns he’s seen succeed, the mistakes to avoid, and why it helps to think of an LLM as an “AI intern” rather than an all-knowing oracle. We talk through: - Why chasing perfect accuracy is a dead end - How to use agents without losing control - Context engineering: fitting the right information in the window - Starting simple instead of over-orchestrating - Separating retrieval from generation in RAG - Splitting complex extractions into smaller checks - Knowing when frameworks help — and when they slow you down A practical guide to avoiding the common traps of LLM development and building systems that actually hold up in production. LINKS: Context Engineering for AI Agents, a free, upcoming lightning lesson from John and Hugo ( https://maven.com/p/4485aa/context-engineering-for-ai-agents ) The Hidden Simplicity of GenAI Systems, a previous lightning lesson from John and Hugo ( https://maven.com/p/a8195d/the-hidden-simplicity-of-gen-ai-systems ) Roaming RAG – RAG without the Vector Database, by John ( https://arcturus-labs.com/blog/2024/11/21/roaming-rag--rag-without-the-vector-database/ ) Cut the Chit-Chat with Artifacts, by John ( https://arcturus-labs.com/blog/2024/11/11/cut-the-chit-chat-with-artifacts/ ) Prompt Engineering for LLMs by John and Albert Ziegler ( https://amzn.to/4gChsFf ) Relevant Search by John and Doug Turnbull ( https://amzn.to/3TXmDHk ) Arcturus Lab…