{"podcast":{"title":"MLOps Weekly Podcast","slug":"mlops-weekly","podcast_index_feed_id":5487202,"rss_url":"https://media.rss.com/mlops-weekly/feed.xml","website_url":"https://rss.com/podcasts/mlops-weekly","image_url":"https://media.rss.com/mlops-weekly/20220607_010653_39e23ec13c42d0efa239e27bf455ceed.jpg","author":"Simba Khadder","episode_count":32,"summary":"Join each week as we talk to MLOps operators, practitioners, and professionals about the current state of MLOps.","last_synced_at":null,"page_url":"https://stenobird.com/podcast/mlops-weekly"},"episode":{"title":"MLOps Week 23: Data Quality & The Future of DataOps with Maxim Lukichev","slug":"mlops-week-23-data-quality-the-future-of-dataops-with-maxim-lukichev","published_at":"2023-11-14T17:19:35+00:00","page_url":"https://stenobird.com/podcast/mlops-weekly/mlops-week-23-data-quality-the-future-of-dataops-with-maxim-lukichev","show_page_url":"https://stenobird.com/podcast/mlops-weekly","url":"https://rss.com/podcasts/mlops-weekly/1221364","audio_url":"https://content.rss.com/episodes/132586/1221364/mlops-weekly/2023_11_14_17_17_40_9cb46f3c-eec6-4cff-ba4f-4ff46c29a65b.mp3","summary":"Data quality is a multi-dimensional challenge involving technical, organizational, and human processes. This episode explores how automated intervention and LLMs can move us beyond manual pipeline fixes and dashboard fatigue.","meta_description":"Learn how to move from reactive data fixing to proactive DataOps using automated interventions and LLM-driven observability.","key_points":["Main idea: Data quality issues are as much about organizational communication and people processes as they are about technical pipelines","Practical takeaway: Automating simple interventions—like splitting good data from bad—can resolve 70% of data quality alerts without stopping the pipeline","Failure mode: Relying on manual 'alert-and-fix' cycles leads to constant pipeline interruptions and engineer burnout","Main idea: The 'Data as a Product' paradigm requires treating data quality with the same rigor as software quality assurance","Future trend: LLMs can act as a summarization layer, transforming thousands of unmanageable dashboards into actionable, high-level insights"],"chapters":[{"start_ms":60000,"title":"The High Cost of Bad Data","summary":"How even small amounts of corrupted data can ruin complex master data management and entity resolution processes."},{"start_ms":195000,"title":"The Multi-Dimensional Challenge","summary":"Why data quality is a complex problem spanning technical volume, velocity, and organizational silos."},{"start_ms":445000,"title":"Data as a Product","summary":"The necessity of implementing quality assurance frameworks when treating data as a core business product."},{"start_ms":805000,"title":"Automating the Feedback Loop","summary":"Moving away from 'stop-the-pipeline' reactive patterns toward automated data splitting and error handling."},{"start_ms":1155000,"title":"The Evolution of the Data Stack","summary":"The consolidation of data observability, catalogs, and the shift toward more integrated DataOps tooling."},{"start_ms":1275000,"title":"LLMs and the Future of Observability","summary":"Using generative AI to summarize massive amounts of telemetry and move beyond the era of dashboard fatigue."}],"topics":["DataOps","Data Quality","Data Observability","Large Language Models","Data Engineering","Automated Pipelines","Root Cause Analysis","Data as a Product"],"duration_seconds":1658,"processing_state":"processed","actions":[{"name":"request_transcript","method":"POST","url":"https://stenobird.com/v1/public/podcasts/mlops-weekly/episodes/mlops-week-23-data-quality-the-future-of-dataops-with-maxim-lukichev/transcription-requests","description":"Idempotently request low-priority transcript generation for this episode."},{"name":"read_markdown","method":"GET","url":"https://stenobird.com/podcast/mlops-weekly/mlops-week-23-data-quality-the-future-of-dataops-with-maxim-lukichev.md","description":"Read the agent-friendly Markdown representation of this episode resource."}]}}