{"podcast":{"title":"Data Engineering Central Podcast","slug":"data-engineering-central-podcast-7106217","podcast_index_feed_id":7106217,"rss_url":"https://api.substack.com/feed/podcast/1224799.rss","website_url":"https://dataengineeringcentral.substack.com/podcast","image_url":"https://substackcdn.com/feed/podcast/1224799/f928778615871704988ed827dec56683.jpg","author":"Data Engineering in Real Life","episode_count":32,"summary":"Long Live the Data Engineer. No holds barred.","last_synced_at":"2026-06-11T02:20:51.548626+00:00","page_url":"https://stenobird.com/podcast/data-engineering-central-podcast-7106217"},"episode":{"title":"Scott Haines on the Future of Data Engineering","slug":"scott-haines-on-the-future-of-data-engineering","published_at":"2025-12-17T13:44:00+00:00","page_url":"https://stenobird.com/podcast/data-engineering-central-podcast-7106217/scott-haines-on-the-future-of-data-engineering","show_page_url":"https://stenobird.com/podcast/data-engineering-central-podcast-7106217","url":"https://dataengineeringcentral.substack.com/p/scott-haines-on-the-future-of-data","audio_url":"https://api.substack.com/feed/podcast/181261013/09ad0a8eed94f4bda0e139df22ed9087.mp3","summary":"In this episode, I sit down with Scott Haines — O’Reilly author, Databricks MVP, and veteran of Yahoo, Nike, and Twilio — for a wide-ranging conversation on the real state of modern data engineering. We dig into open-source ecosystems, Lakehouse architectures, the evolution of Spark, streaming, what’s broken and what’s working in today’s data tooling, and the lessons Scott has learned scaling platforms at some of the biggest companies in the world. If you care about data engineering, architecture, OSS, or the future of the modern data stack, you’ll love this one. Thanks for reading Data Engineering Central! This post is public so feel free to share it. Make sure to follow Scott here on Substack , and over on GitHub. This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit dataengineeringcentral.substack.com/subscribe","meta_description":"In this episode, I sit down with Scott Haines — O’Reilly author, Databricks MVP, and veteran of Yahoo, Nike, and Twilio — for a wide-ranging conversation…","key_points":[],"chapters":[],"topics":[],"duration_seconds":6660,"processing_state":"not_requested","actions":[{"name":"request_transcript","method":"POST","url":"https://stenobird.com/v1/public/podcasts/data-engineering-central-podcast-7106217/episodes/scott-haines-on-the-future-of-data-engineering/transcription-requests","description":"Idempotently request low-priority transcript generation for this episode."},{"name":"read_markdown","method":"GET","url":"https://stenobird.com/podcast/data-engineering-central-podcast-7106217/scott-haines-on-the-future-of-data-engineering.md","description":"Read the agent-friendly Markdown representation of this episode resource."}]}}