# MLOps Week 23: Data Quality & The Future of DataOps with Maxim Lukichev

Page: https://stenobird.com/podcast/mlops-weekly/mlops-week-23-data-quality-the-future-of-dataops-with-maxim-lukichev
Text version: https://stenobird.com/podcast/mlops-weekly/mlops-week-23-data-quality-the-future-of-dataops-with-maxim-lukichev.md
Podcast: [MLOps Weekly Podcast](https://stenobird.com/podcast/mlops-weekly)
Published: 2023-11-14T17:19:35+00:00
Episode link: https://rss.com/podcasts/mlops-weekly/1221364
Audio file: https://content.rss.com/episodes/132586/1221364/mlops-weekly/2023_11_14_17_17_40_9cb46f3c-eec6-4cff-ba4f-4ff46c29a65b.mp3
Processing state: processed
JSON: https://stenobird.com/v1/public/podcasts/mlops-weekly/episodes/mlops-week-23-data-quality-the-future-of-dataops-with-maxim-lukichev
Duration seconds: 1658

## Resource

Data quality is a multi-dimensional challenge involving technical, organizational, and human processes. This episode explores how automated intervention and LLMs can move us beyond manual pipeline fixes and dashboard fatigue.

## Highlights
- Main idea: Data quality issues are as much about organizational communication and people processes as they are about technical pipelines
- Practical takeaway: Automating simple interventions—like splitting good data from bad—can resolve 70% of data quality alerts without stopping the pipeline
- Failure mode: Relying on manual 'alert-and-fix' cycles leads to constant pipeline interruptions and engineer burnout
- Main idea: The 'Data as a Product' paradigm requires treating data quality with the same rigor as software quality assurance
- Future trend: LLMs can act as a summarization layer, transforming thousands of unmanageable dashboards into actionable, high-level insights

## Topics

DataOps, Data Quality, Data Observability, Large Language Models, Data Engineering, Automated Pipelines, Root Cause Analysis, Data as a Product

## Chapters
- 1:00 — The High Cost of Bad Data: How even small amounts of corrupted data can ruin complex master data management and entity resolution processes.
- 3:15 — The Multi-Dimensional Challenge: Why data quality is a complex problem spanning technical volume, velocity, and organizational silos.
- 7:25 — Data as a Product: The necessity of implementing quality assurance frameworks when treating data as a core business product.
- 13:25 — Automating the Feedback Loop: Moving away from 'stop-the-pipeline' reactive patterns toward automated data splitting and error handling.
- 19:15 — The Evolution of the Data Stack: The consolidation of data observability, catalogs, and the shift toward more integrated DataOps tooling.
- 21:15 — LLMs and the Future of Observability: Using generative AI to summarize massive amounts of telemetry and move beyond the era of dashboard fatigue.

## Actions

- request_transcript: `POST https://stenobird.com/v1/public/podcasts/mlops-weekly/episodes/mlops-week-23-data-quality-the-future-of-dataops-with-maxim-lukichev/transcription-requests` — Idempotently request low-priority transcript generation for this episode.
- read_markdown: `GET https://stenobird.com/podcast/mlops-weekly/mlops-week-23-data-quality-the-future-of-dataops-with-maxim-lukichev.md` — Read the agent-friendly Markdown representation of this episode resource.

A page view does not enqueue transcription. Agents should invoke `request_transcript` explicitly when they need this episode processed.

## Transcript

Full transcripts are not published on public pages unless there is a clear rights basis.