{"podcast":{"title":"Data Science With Sam","slug":"data-science-with-sam-4345646","podcast_index_feed_id":4345646,"rss_url":"https://media.rss.com/data-science-with-sam/feed.xml","website_url":"https://datasciencewithsam-hub.replit.app/","image_url":"https://media.rss.com/data-science-with-sam/podcast_cover_20260727_001627_afba4f0b63c3e761e747d1e7aaa0930f.png","author":"Soumava Dey","episode_count":46,"summary":"This is an educational podcast focused on bringing academia and industry experts together in a common forum and initiate discussion geared towards data science, artificial intelligence, actuarial science and scientific research. DISCLAIMER: The views and opinions expressed in this podcast are solely those of the host(s) or guest(s) and do not necessarily reflect the policy or position of any organization. The podcast is intended to provide general educational information and entertainment purposes only. RSSVERIFY","last_synced_at":"2026-07-27T06:21:57.269474+00:00","page_url":"https://stenobird.com/podcast/data-science-with-sam-4345646"},"episode":{"title":"EP 45: Why AI Agents Break in Production: The Missing Harness in Your Data Stack","slug":"ep-45-why-ai-agents-break-in-production-the-missing-harness-in-your-data-stack","published_at":"2026-07-15T03:25:20+00:00","page_url":"https://stenobird.com/podcast/data-science-with-sam-4345646/ep-45-why-ai-agents-break-in-production-the-missing-harness-in-your-data-stack","show_page_url":"https://stenobird.com/podcast/data-science-with-sam-4345646","url":"https://rss.com/podcasts/data-science-with-sam/3006403","audio_url":"https://content.rss.com/episodes/395137/3006403/data-science-with-sam/2026_07_20_13_46_51_84717aef-e87c-4613-bcd0-6db27dd42a55.mp3","summary":"An independent evaluation of Snowflake's Cortex Analyst found 6 in 10 AI-generated queries were wrong — but they all compiled and ran without a single error. That's not a model problem. That's a missing harness problem. Pradnesh Patil is the Co-Founder and CEO of Altimate AI — a platform bringing agentic AI to data engineering with tools trusted by Fortune 500s and downloaded more than 1 million times across 200+ countries. Before Altimate, he spent a decade in product leadership at Palo Alto Networks, Cisco, and VMware.   IN THIS EPISODE: ▪  The five components of an agentic data engineering harness: context, governance, MCP tools, shared skills, and agent infrastructure — and why missing any one of them causes silent failures ▪  Why a system prompt cannot substitute for a harness: a prompt tells the model what to do, a harness tells it what is actually true ▪  Where the 27–33% phantom table references and 78% silent wrong joins come from — and why it's not the LLM's fault ▪  How Altimate Code topped ADE-Bench using Sonnet while competitors used Opus — proof that the harness matters more than the model ▪  The deterministic vs LLM boundary: why validation, cost checks, and query correctness are deterministic jobs and should never go to an LLM ▪  Context compaction innovation: why standard LLM compaction destroys long-running data engineering tasks — and how Altimate fixed it ▪  The $5,000 Cortex AI query bill — and how permission-based governance controls prevent agents from going rogue on your cloud bill ▪  The future of data engineering: days of writing SQL by hand are ending — what the data engineer's role becomes in an agentic world ▪  Pradnesh's advice: build open source, build cross-platform — avoid siloed AI feat…","meta_description":"An independent evaluation of Snowflake's Cortex Analyst found 6 in 10 AI-generated queries were wrong — but they all compiled and ran without a single err…","key_points":[],"chapters":[],"topics":[],"duration_seconds":1952,"processing_state":"not_requested","actions":[{"name":"request_transcript","method":"POST","url":"https://stenobird.com/v1/public/podcasts/data-science-with-sam-4345646/episodes/ep-45-why-ai-agents-break-in-production-the-missing-harness-in-your-data-stack/transcription-requests","description":"Idempotently request low-priority transcript generation for this episode."},{"name":"read_markdown","method":"GET","url":"https://stenobird.com/podcast/data-science-with-sam-4345646/ep-45-why-ai-agents-break-in-production-the-missing-harness-in-your-data-stack.md","description":"Read the agent-friendly Markdown representation of this episode resource."}]}}