{"podcast":{"title":"The Data Exchange with Ben Lorica","slug":"the-data-exchange-with-ben-lorica","podcast_index_feed_id":1196000,"rss_url":"https://rss.buzzsprout.com/682433.rss","website_url":"https://thedataexchange.media/","image_url":"https://storage.buzzsprout.com/ljk0yj7r22pi61grsmelnsoa9084?.jpg","author":"Ben Lorica","episode_count":345,"summary":"A series of informal conversations with thought leaders, researchers, practitioners, and writers on a wide range of topics in technology, science, and of course big data, data science, artificial intelligence, and related applications. Anchored by Ben Lorica (@BigData), the Data Exchange also features a roundup of the most important stories from the worlds of data, machine learning and AI. Detailed show notes for each episode can be found on https://thedataexchange.media/ The Data Exchange podcast is a production of Gradient Flow [https://gradientflow.com/].","last_synced_at":null,"page_url":"https://stenobird.com/podcast/the-data-exchange-with-ben-lorica"},"episode":{"title":"The Gap Between AI Hype and Enterprise Reality","slug":"the-gap-between-ai-hype-and-enterprise-reality","published_at":"2026-05-07T11:00:00+00:00","page_url":"https://stenobird.com/podcast/the-data-exchange-with-ben-lorica/the-gap-between-ai-hype-and-enterprise-reality","show_page_url":"https://stenobird.com/podcast/the-data-exchange-with-ben-lorica","url":"https://dts.podtrac.com/redirect.mp3/www.buzzsprout.com/682433/episodes/19098049-the-gap-between-ai-hype-and-enterprise-reality.mp3","audio_url":"https://dts.podtrac.com/redirect.mp3/www.buzzsprout.com/682433/episodes/19098049-the-gap-between-ai-hype-and-enterprise-reality.mp3","summary":"Enterprises are struggling to bridge the gap between impressive AI demos and reliable production deployment. The discussion focuses on managing the shift from deterministic computing to non-deterministic, probabilistic models.","meta_description":"Learn why enterprises struggle with AI deployment, the importance of evaluation frameworks, and how to move from prompt engineering to fine-tuning.","key_points":["Main idea: Moving from deterministic to non-deterministic models requires new testing and infrastructure to manage probabilistic outputs","Practical takeaway: Prioritize building robust evaluation (eval) frameworks before attempting complex techniques like reinforcement learning","Failure mode: Expecting 100% accuracy from LLMs in automated workflows can lead to system failure; build human-in-the-loop review interfaces instead","Practical takeaway: Use a tiered approach to model optimization: start with prompt engineering, move to fine-tuning, and only then attempt reinforcement learning","Main idea: Model agnosticism is critical for long-term stability as API standards and provider capabilities diverge"],"chapters":[{"start_ms":60000,"title":"The Challenge of Non-Deterministic Models","summary":"The difficulty of achieving high accuracy in enterprise workflows when moving from deterministic logic to probabilistic LLMs."},{"start_ms":330000,"title":"Ownership and Infrastructure","summary":"Navigating the tension between IT-led infrastructure and business-driven AI adoption."},{"start_ms":580000,"title":"Optimization Strategies","summary":"Discussing the utility of tools like DSPy and the transition from fine-tuning to more complex methods."},{"start_ms":820000,"title":"Context and Information Density","summary":"Why providing too much raw data can hinder LLM performance and the need for structured context."},{"start_ms":1070000,"title":"Structuring Unstructured Data","summary":"Using LLMs to transform unstructured information into queryable, structured formats."},{"start_ms":1330000,"title":"Human-in-the-Loop Interfaces","summary":"The necessity of review interfaces for analysts to correct model errors in automated processes."},{"start_ms":1580000,"title":"The Rise of AI Agents","summary":"How agents are moving beyond coding into marketing and operational business tasks."}],"topics":["Generative AI","Enterprise AI","LLM Evaluation","Model Fine-tuning","AI Agents","Data Infrastructure","Non-deterministic Computing","Databricks"],"duration_seconds":3382,"processing_state":"processed","actions":[{"name":"request_transcript","method":"POST","url":"https://stenobird.com/v1/public/podcasts/the-data-exchange-with-ben-lorica/episodes/the-gap-between-ai-hype-and-enterprise-reality/transcription-requests","description":"Idempotently request low-priority transcript generation for this episode."},{"name":"read_markdown","method":"GET","url":"https://stenobird.com/podcast/the-data-exchange-with-ben-lorica/the-gap-between-ai-hype-and-enterprise-reality.md","description":"Read the agent-friendly Markdown representation of this episode resource."}]}}