{"podcast":{"title":"Adventures in Machine Learning","slug":"adventures-in-machine-learning","podcast_index_feed_id":2981332,"rss_url":"https://www.spreaker.com/show/6102041/episodes/feed","website_url":"https://topenddevs.com/podcasts/adventures-in-machine-learning","image_url":"https://d3wo5wojvuv7l.cloudfront.net/t_rss_itunes_square_1400/images.spreaker.com/original/230facb439840ff787c776d3ed78fcbd.jpg","author":"Charles M Wood","episode_count":209,"summary":"Machine Learning is growing in leaps and bounds both in capability and adoption. Listen to our experts discuss the ideas and fundamentals needed to succeed as a Machine Learning Engineer. Become a supporter of this podcast: https://www.spreaker.com/podcast/adventures-in-machine-learning--6102041/support .","last_synced_at":null,"page_url":"https://stenobird.com/podcast/adventures-in-machine-learning"},"episode":{"title":"Crafting Data Solutions: Shrinking Pie and Leveraging Insights for Optimal Data Learning - ML 176","slug":"crafting-data-solutions-shrinking-pie-and-leveraging-insights-for-optimal-data-learning-ml-176","published_at":"2024-11-28T11:00:00+00:00","page_url":"https://stenobird.com/podcast/adventures-in-machine-learning/crafting-data-solutions-shrinking-pie-and-leveraging-insights-for-optimal-data-learning-ml-176","show_page_url":"https://stenobird.com/podcast/adventures-in-machine-learning","url":"https://www.spreaker.com/episode/crafting-data-solutions-shrinking-pie-and-leveraging-insights-for-optimal-data-learning-ml-176--63122287","audio_url":"https://dts.podtrac.com/redirect.mp3/api.spreaker.com/download/episode/63122287/ml_176.mp3","summary":"As data growth outpaces Moore's Law, traditional database performance is becoming unsustainable. Barzan Mozafari explains how automated cloud optimization and query rewriting can bridge this gap and reclaim wasted infrastructure spend.","meta_description":"Learn how to optimize cloud data costs and manage technical debt using automated workload intelligence and AI-driven query rewriting.","key_points":["Main idea: Data growth is currently outpacing hardware improvements, creating a performance gap that requires intelligent automation rather than just more hardware","Practical takeaway: Use automated workload intelligence to optimize existing data stacks like Snowflake without needing to migrate platforms","Failure mode: Relying on manual infrastructure management leads to exponential cost increases as data volumes scale","Lesson: The 'fail fast' mentality of academic research—testing ideas through rapid experimentation—is highly effective for B2B software development","Future trend: Large Language Models (LLMs) are being applied to query rewriting to significantly enhance database efficiency"],"chapters":[{"start_ms":65000,"title":"The Crisis of Data Growth","summary":"Barzan Mozafari discusses why the divergence between data volume growth and Moore's Law makes traditional database scaling unsustainable."},{"start_ms":345000,"title":"The Keebo Business Model","summary":"An exploration of the incentive structures in cloud optimization and how Keebo aligns its success with customer cost savings."},{"start_ms":885000,"title":"Avoiding Platform Lock-in","summary":"Why modern optimization tools should work with your existing data stack rather than forcing expensive migrations to new platforms."},{"start_ms":1430000,"title":"Unlocking Business Value","summary":"How reducing infrastructure overhead allows engineering teams to redirect resources toward core product innovation and business growth."},{"start_ms":1980000,"title":"Applying Academic Rigor to Industry","summary":"The benefits of bringing research-driven 'fail fast' methodologies and deep problem-solving skills into the commercial software lifecycle."},{"start_ms":2850000,"title":"The Future of Query Optimization","summary":"A look at the potential of LLMs in query rewriting and the challenges of managing expectations around AI agents in data engineering."}],"topics":["Cloud Optimization","Data Engineering","Snowflake","Query Rewriting","Infrastructure Costs","Machine Learning","Database Performance","Automation"],"duration_seconds":3343,"processing_state":"processed","actions":[{"name":"request_transcript","method":"POST","url":"https://stenobird.com/v1/public/podcasts/adventures-in-machine-learning/episodes/crafting-data-solutions-shrinking-pie-and-leveraging-insights-for-optimal-data-learning-ml-176/transcription-requests","description":"Idempotently request low-priority transcript generation for this episode."},{"name":"read_markdown","method":"GET","url":"https://stenobird.com/podcast/adventures-in-machine-learning/crafting-data-solutions-shrinking-pie-and-leveraging-insights-for-optimal-data-learning-ml-176.md","description":"Read the agent-friendly Markdown representation of this episode resource."}]}}