{"podcast":{"title":"Talk Python To Me","slug":"talk-python-to-me","podcast_index_feed_id":742305,"rss_url":"https://talkpython.fm/episodes/rss","website_url":"https://talkpython.fm/","image_url":"https://cdn-podcast.talkpython.fm/static/img/talk-python-3000.jpg","author":"Michael Kennedy","episode_count":546,"summary":"Talk Python to Me is a weekly podcast hosted by developer and entrepreneur Michael Kennedy. We dive deep into the popular packages and software developers, data scientists, and incredible hobbyists doing amazing things with Python. If you're new to Python, you'll quickly learn the ins and outs of the community by hearing from the leaders. And if you've been Pythoning for years, you'll learn about your favorite packages and the hot new ones coming out of open source.","last_synced_at":null,"page_url":"https://stenobird.com/podcast/talk-python-to-me"},"episode":{"title":"#528: Python apps with LLM building blocks","slug":"528-python-apps-with-llm-building-blocks","published_at":"2025-11-30T08:00:00+00:00","page_url":"https://stenobird.com/podcast/talk-python-to-me/528-python-apps-with-llm-building-blocks","show_page_url":"https://stenobird.com/podcast/talk-python-to-me","url":"https://talkpython.fm/episodes/show/528/python-apps-with-llm-building-blocks","audio_url":"https://talkpython.fm/episodes/download/528/python-apps-with-llm-building-blocks.mp3","summary":"Treat Large Language Models as standard, decoupled APIs within your Python architecture rather than magic black boxes. Learn how to implement clear boundaries, focused endpoints, and robust monitoring to build reliable AI-integrated applications.","meta_description":"Learn architectural patterns for integrating LLMs into Python apps using clear boundaries, caching, and structured output techniques.","key_points":["Main idea: Treat LLM calls as standard API dependencies with defined boundaries and small, focused endpoints","Practical takeaway: Use caching and inspection patterns to manage costs and verify the reliability of non-deterministic responses","Failure mode: Avoid treating LLMs as a replacement for structured logic; instead, use them as building blocks within a larger, typed system","Practical takeaway: Implement monitoring and evaluations to ensure LLM performance meets application requirements","Main idea: Leverage abstraction layers to switch between different providers like OpenAI and Anthropic without rewriting core logic"],"chapters":[{"start_ms":405000,"title":"The AI Hype Landscape","summary":"A discussion on the current state of AI hype and the impact of LLM advancements on the developer ecosystem."},{"start_ms":745000,"title":"Software Engineering for Data Science","summary":"Exploring how software engineering best practices can bring reliability to data science and machine learning workflows."},{"start_ms":1445000,"title":"LLMs as Modular Building Blocks","summary":"Architectural strategies for treating LLM APIs as interchangeable components regardless of the provider."},{"start_ms":1790000,"title":"Caching and Storage Strategies","summary":"Using local storage and SQLite for caching LLM responses to improve performance and reduce latency."},{"start_ms":2510000,"title":"Abstraction Layers and Tooling","summary":"Using libraries to abstract across different LLM providers like Anthropic and OpenAI."},{"start_ms":3190000,"title":"Structured Output and Type Safety","summary":"Leveraging modern LLM capabilities for structured tasks and the importance of using types in Python."},{"start_ms":4250000,"title":"Recommended Tools and Final Advice","summary":"A roundup of useful libraries and tools for building production-ready Python applications with LLMs."}],"topics":["Python","LLM","Software Architecture","API Design","Machine Learning","Caching","Data Engineering","AI Integration"],"duration_seconds":4606,"processing_state":"processed","actions":[{"name":"request_transcript","method":"POST","url":"https://stenobird.com/v1/public/podcasts/talk-python-to-me/episodes/528-python-apps-with-llm-building-blocks/transcription-requests","description":"Idempotently request low-priority transcript generation for this episode."},{"name":"read_markdown","method":"GET","url":"https://stenobird.com/podcast/talk-python-to-me/528-python-apps-with-llm-building-blocks.md","description":"Read the agent-friendly Markdown representation of this episode resource."}]}}