{"podcast":{"title":"MLOps Weekly Podcast","slug":"mlops-weekly","podcast_index_feed_id":5487202,"rss_url":"https://media.rss.com/mlops-weekly/feed.xml","website_url":"https://rss.com/podcasts/mlops-weekly","image_url":"https://media.rss.com/mlops-weekly/20220607_010653_39e23ec13c42d0efa239e27bf455ceed.jpg","author":"Simba Khadder","episode_count":32,"summary":"Join each week as we talk to MLOps operators, practitioners, and professionals about the current state of MLOps.","last_synced_at":null,"page_url":"https://stenobird.com/podcast/mlops-weekly"},"episode":{"title":"MLOps Week 27: Unveiling AI's Infrastructure Evolution with Outerbound’s CEO","slug":"mlops-week-27-unveiling-ai-s-infrastructure-evolution-with-outerbound-s-ceo","published_at":"2024-02-29T14:40:19+00:00","page_url":"https://stenobird.com/podcast/mlops-weekly/mlops-week-27-unveiling-ai-s-infrastructure-evolution-with-outerbound-s-ceo","show_page_url":"https://stenobird.com/podcast/mlops-weekly","url":"https://rss.com/podcasts/mlops-weekly/1367881","audio_url":"https://content.rss.com/episodes/132586/1367881/mlops-weekly/2024_02_29_14_37_45_b09a45a9-1d63-476e-a1b6-6949805dac2f.mp3","summary":"The evolution of ML infrastructure from Netflix's Metaflow to modern LLM orchestration. The discussion explores why human-centric design is critical for scaling AI beyond engineering teams.","meta_description":"Explore the evolution of MLOps, from Netflix's Metaflow origins to the unique infrastructure challenges of LLMs and fine-tuning at scale.","key_points":["Main idea: Effective ML infrastructure must bridge the gap between data engineering platforms and the diverse needs of data scientists","Practical takeaway: Human-centric infrastructure should abstract away complex engineering tasks like Docker image creation for non-engineer users","Failure mode: Treating ML development exactly like traditional DevOps ignores the unique complexities of data and model artifacts","Main idea: The rise of LLMs is expanding ML use cases into unstructured data domains like fraud detection and NLP","Practical takeaway: Scaling LLM fine-tuning requires managing distributed workloads across smaller, available GPUs rather than relying solely on high-end hardware"],"chapters":[{"start_ms":60000,"title":"The Origins of Metaflow at Netflix","summary":"How the need to scale ML beyond recommendation systems led to the creation of Metaflow to bridge the gap between engineering and data science."},{"start_ms":205000,"title":"Verticalized AI Solutions","summary":"A debate on whether the diverse use cases of modern AI require specialized, verticalized MLOps platforms."},{"start_ms":345000,"title":"The MLOps Tech Stack","summary":"Analyzing the layers of the ML stack, including data warehousing, compute platforms, and orchestration systems like Airflow."},{"start_ms":490000,"title":"Managing ML Artifacts","summary":"The unique challenge of orchestrating the intersection of code, data, and model artifacts."},{"start_ms":775000,"title":"Human-Centric Infrastructure","summary":"Why prioritizing the developer experience for scientists with diverse backgrounds is a competitive advantage."},{"start_ms":1210000,"title":"Unlocking New Use Cases with LLMs","summary":"How LLMs are enabling ML adoption in previously 'messy' or unstructured data domains."},{"start_ms":1495000,"title":"Scaling LLM Fine-Tuning","summary":"Strategies for performing large-scale fine-tuning using available, smaller GPU clusters."}],"topics":["MLOps","LLM Infrastructure","Metaflow","Machine Learning Engineering","Data Science","AI Orchestration","Model Fine-tuning","Cloud Infrastructure"],"duration_seconds":1917,"processing_state":"processed","actions":[{"name":"request_transcript","method":"POST","url":"https://stenobird.com/v1/public/podcasts/mlops-weekly/episodes/mlops-week-27-unveiling-ai-s-infrastructure-evolution-with-outerbound-s-ceo/transcription-requests","description":"Idempotently request low-priority transcript generation for this episode."},{"name":"read_markdown","method":"GET","url":"https://stenobird.com/podcast/mlops-weekly/mlops-week-27-unveiling-ai-s-infrastructure-evolution-with-outerbound-s-ceo.md","description":"Read the agent-friendly Markdown representation of this episode resource."}]}}