{"podcast":{"title":"Beyond The Pilot: Enterprise AI in Action","slug":"beyond-the-pilot-enterprise-ai-in-action-7531113","podcast_index_feed_id":7531113,"rss_url":"https://feeds.megaphone.fm/UTEAU6270845142","website_url":null,"image_url":"https://megaphone.imgix.net/podcasts/2eacf1e6-89b2-11f0-8a6f-13263c2b3be9/image/303aa3d4fcd77adce1002a0f6735a3fb.png?ixlib=rails-4.3.1&max-w=3000&max-h=3000&fit=crop&auto=format,compress","author":"VentureBeat","episode_count":32,"summary":"AI gets real here. On “Beyond the Pilot,” top business execs share what actually happens after the AI proof of concept — from infrastructure and org design to wins, failures, and ROI. Not theory, but deep dives into how they scaled AI that works.","last_synced_at":"2026-06-24T22:19:17.509819+00:00","page_url":"https://stenobird.com/podcast/beyond-the-pilot-enterprise-ai-in-action-7531113"},"episode":{"title":"How Booking.com Boosted Agent Accuracy 2x with Mini LLMs with Pranav Pathak","slug":"how-booking-com-boosted-agent-accuracy-2x-with-mini-llms-with-pranav-pathak","published_at":"2025-12-03T11:30:00+00:00","page_url":"https://stenobird.com/podcast/beyond-the-pilot-enterprise-ai-in-action-7531113/how-booking-com-boosted-agent-accuracy-2x-with-mini-llms-with-pranav-pathak","show_page_url":"https://stenobird.com/podcast/beyond-the-pilot-enterprise-ai-in-action-7531113","url":"https://traffic.megaphone.fm/UTEAU2545255799.mp3?updated=1764696558","audio_url":"https://traffic.megaphone.fm/UTEAU2545255799.mp3?updated=1764696558","summary":"We built AI agents by accident... and it worked. 🤯 In this episode of VentureBeat’s Beyond the Pilot, we go inside the engineering brain of Booking.com with Pranav Pathak (Director of Product Machine Learning). Pranav reveals how they \"stumbled\" into agentic architectures before the term even existed, how a simple text box revealed a massive missed revenue opportunity (the \"Hot Tub\" story), and exactly how they stack LLMs, RAG, and Orchestrators to handle millions of travelers without breaking the bank. If you are building Enterprise AI, this is the blueprint for moving from \"cool demo\" to production scale. 🚀 In this episode, we cover: The \"Hot Tub\" Revelation: How free-text AI search exposed features customers desperately wanted but couldn't find. Real ROI Metrics: How LLMs drove a 2x increase in topic detection accuracy and freed up 1.5x of agent bandwidth. The Booking.com AI Stack: A full breakdown of their Orchestrator → Moderation → Agent → RAG architecture. Latency vs. Intelligence: Why they don't use GPT-5 for everything and how they decide between small models and big brains. The Memory Problem: How to build AI that remembers user preferences without being \"creepy”. 00:00 Introduction to Agentic Architectures 00:30 Meet Pranav Pathak from Booking.com 01:24 Evolution of Travel Recommendations 03:41 Impact of Gen AI on Customer Service 07:29 Building an Effective AI Stack 10:32 Agentic Systems and Best Practices 13:45 Choosing Between Building and Buying AI Solutions 18:51 Evaluating AI Models for Business Use 24:10 Challenges in Human Evaluation 25:06 Recommendation System and Data Utilization 27:26 Innovations in Travel Search 29:04 Journey and Challenges in ML Integration 32:08 Managing Memory and User Data 38:07 Future of Travel Assistance 41:33 Advice for Ne…","meta_description":"We built AI agents by accident... and it worked. 🤯 In this episode of VentureBeat’s Beyond the Pilot, we go inside the engineering brain of Booking.com wi…","key_points":[],"chapters":[],"topics":[],"duration_seconds":2747,"processing_state":"not_requested","actions":[{"name":"request_transcript","method":"POST","url":"https://stenobird.com/v1/public/podcasts/beyond-the-pilot-enterprise-ai-in-action-7531113/episodes/how-booking-com-boosted-agent-accuracy-2x-with-mini-llms-with-pranav-pathak/transcription-requests","description":"Idempotently request low-priority transcript generation for this episode."},{"name":"read_markdown","method":"GET","url":"https://stenobird.com/podcast/beyond-the-pilot-enterprise-ai-in-action-7531113/how-booking-com-boosted-agent-accuracy-2x-with-mini-llms-with-pranav-pathak.md","description":"Read the agent-friendly Markdown representation of this episode resource."}]}}