{"podcast":{"title":"MLOps Weekly Podcast","slug":"mlops-weekly","podcast_index_feed_id":5487202,"rss_url":"https://media.rss.com/mlops-weekly/feed.xml","website_url":"https://rss.com/podcasts/mlops-weekly","image_url":"https://media.rss.com/mlops-weekly/20220607_010653_39e23ec13c42d0efa239e27bf455ceed.jpg","author":"Simba Khadder","episode_count":32,"summary":"Join each week as we talk to MLOps operators, practitioners, and professionals about the current state of MLOps.","last_synced_at":null,"page_url":"https://stenobird.com/podcast/mlops-weekly"},"episode":{"title":"MLOps Week 15: The Business Impact of MLOps with Liran Hason","slug":"mlops-week-15-the-business-impact-of-mlops-with-liran-hason","published_at":"2023-02-07T18:03:58+00:00","page_url":"https://stenobird.com/podcast/mlops-weekly/mlops-week-15-the-business-impact-of-mlops-with-liran-hason","show_page_url":"https://stenobird.com/podcast/mlops-weekly","url":"https://rss.com/podcasts/mlops-weekly/814138","audio_url":"https://content.rss.com/episodes/132586/814138/mlops-weekly/2023_02_07_07_20_38_47618b48-236d-410c-b914-fcbb557f8e20.mp3","summary":"Transitioning from building machine learning models to engineering machine learning products is the key to unlocking business value. This discussion explores how observability and product-centric thinking bridge the gap between technical performance and bottom-line impact.","meta_description":"Learn how to shift from ML models to ML products by focusing on observability, business KPIs, and the emerging role of ML Product Managers.","key_points":["Main idea: Successful MLOps requires moving beyond model accuracy to focus on the end-user experience and business outcomes","Practical takeaway: Implement proxy metrics like data drift to monitor model health during the latency period before ground truth labels are available","Failure mode: Treating ML as a siloed technical task rather than a software product leads to models that lack measurable business impact","Emerging trend: The rise of the ML Product Manager (MLPM) to translate complex data science metrics into actionable business KPIs","Strategic approach: Use observability tools as a 'Mixpanel for AI' to track model usage, predictions, and their direct link to business results"],"chapters":[{"start_ms":60000,"title":"The Origin of Model Monitoring","summary":"Liran describes the transition from using simple Python cron jobs for infrastructure monitoring to founding a dedicated observability company."},{"start_ms":210000,"title":"The MLOps Maturity Gap","summary":"Many companies have invested heavily in data and science teams but struggle to realize the actual value of their models in production."},{"start_ms":360000,"title":"Platform vs. Best-of-Breed","summary":"A debate on whether specialized data science teams should build custom solutions or adopt integrated platforms."},{"start_ms":500000,"title":"The Complexity of ML Infrastructure","summary":"Exploring the deep technical challenges in feature stores, including time travel, security, and collaborative access."},{"start_ms":650000,"title":"Using Proxy Metrics for Drift","summary":"How to maintain model oversight using data drift and other indicators while waiting for ground truth labels."},{"start_ms":940000,"title":"Defining the ML Product","summary":"Shifting the mindset from building isolated models to creating software products that serve specific user goals."},{"start_ms":1080000,"title":"The Rise of the MLPM","summary":"The growing demand for Product Managers who can bridge the gap between technical ML metrics and business requirements."},{"start_ms":1545000,"title":"Measuring Success with Three Pillars","summary":"A framework for setting goals across business metrics, usage patterns, and model performance."}],"topics":["MLOps","Model Observability","Machine Learning Product Management","Data Drift","ML Infrastructure","Business Intelligence","Model Monitoring","AI Product Strategy"],"duration_seconds":2004,"processing_state":"processed","actions":[{"name":"request_transcript","method":"POST","url":"https://stenobird.com/v1/public/podcasts/mlops-weekly/episodes/mlops-week-15-the-business-impact-of-mlops-with-liran-hason/transcription-requests","description":"Idempotently request low-priority transcript generation for this episode."},{"name":"read_markdown","method":"GET","url":"https://stenobird.com/podcast/mlops-weekly/mlops-week-15-the-business-impact-of-mlops-with-liran-hason.md","description":"Read the agent-friendly Markdown representation of this episode resource."}]}}