{"podcast":{"title":"MLOps Weekly Podcast","slug":"mlops-weekly","podcast_index_feed_id":5487202,"rss_url":"https://media.rss.com/mlops-weekly/feed.xml","website_url":"https://rss.com/podcasts/mlops-weekly","image_url":"https://media.rss.com/mlops-weekly/20220607_010653_39e23ec13c42d0efa239e27bf455ceed.jpg","author":"Simba Khadder","episode_count":32,"summary":"Join each week as we talk to MLOps operators, practitioners, and professionals about the current state of MLOps.","last_synced_at":null,"page_url":"https://stenobird.com/podcast/mlops-weekly"},"episode":{"title":"MLOps Week 31: Bridging Software Engineering and MLOps with Paul lusztin of Decoding ML","slug":"mlops-week-31-bridging-software-engineering-and-mlops-with-paul-lusztin-of-decoding-ml","published_at":"2024-08-01T18:54:39+00:00","page_url":"https://stenobird.com/podcast/mlops-weekly/mlops-week-31-bridging-software-engineering-and-mlops-with-paul-lusztin-of-decoding-ml","show_page_url":"https://stenobird.com/podcast/mlops-weekly","url":"https://rss.com/podcasts/mlops-weekly/1594826","audio_url":"https://content.rss.com/episodes/132586/1594826/mlops-weekly/2024_08_01_18_54_05_f7e9f5e1-27eb-4d95-ba6e-f2afa0590a20.mp3","summary":"Transitioning from software engineering to MLOps requires shifting from an API-centric mindset to a data-centric one. This discussion explores how engineering principles apply to the non-deterministic challenges of LLM evaluation and pipeline architecture.","meta_description":"Explore the convergence of MLOps and LLMOps, focusing on evaluation strategies, pipeline decoupling, and the shift from software to data-centric engineeri…","key_points":["Main idea: MLOps requires a fundamental shift from focusing on application layers to prioritizing data and model lineage","Practical takeaway: Decouple feature, training, and inference pipelines to build scalable and reproducible platforms","Failure mode: Building custom MLOps infrastructure from scratch often yields low ROI compared to using established, industry-standard tools","Technical insight: Using a more powerful 'teacher' model to evaluate a smaller 'student' model is a viable strategy for managing LLM uncertainty","Core challenge: The hardest problems in LLMOps remain centered on data quality and the lack of reliable, deterministic evaluation frameworks"],"chapters":[{"start_ms":60000,"title":"The Journey to MLOps","summary":"A look at the transition from software engineering and deep learning research into the specialized field of MLOps."},{"start_ms":360000,"title":"The Data-Centric Shift","summary":"How moving into MLOps changes your focus from APIs and UI layers to the primacy of data and models."},{"start_ms":660000,"title":"Architecting Pipelines","summary":"The importance of decoupling feature processing, training, and inference for real-time systems."},{"start_ms":930000,"title":"Build vs. Buy in MLOps","summary":"Why the ROI of building custom ML infrastructure has decreased as standardized tools mature."},{"start_ms":1085000,"title":"The Evaluation Crisis","summary":"Discussing the risks of using LLMs to evaluate themselves and the necessity of high-quality 'spoiler' models."},{"start_ms":1525000,"title":"LLMOps and Vector Databases","summary":"Analyzing how LLMs extend traditional data patterns through embeddings and vector search."},{"start_ms":1810000,"title":"The ML Engineer's Advantage","summary":"Why engineers experienced with black-box models are uniquely positioned to handle non-deterministic APIs."}],"topics":["MLOps","LLMOps","Machine Learning Engineering","Model Evaluation","Vector Databases","Data-Centric AI","Software Engineering","Inference Pipelines"],"duration_seconds":1978,"processing_state":"processed","actions":[{"name":"request_transcript","method":"POST","url":"https://stenobird.com/v1/public/podcasts/mlops-weekly/episodes/mlops-week-31-bridging-software-engineering-and-mlops-with-paul-lusztin-of-decoding-ml/transcription-requests","description":"Idempotently request low-priority transcript generation for this episode."},{"name":"read_markdown","method":"GET","url":"https://stenobird.com/podcast/mlops-weekly/mlops-week-31-bridging-software-engineering-and-mlops-with-paul-lusztin-of-decoding-ml.md","description":"Read the agent-friendly Markdown representation of this episode resource."}]}}