# Spark, Lakehouse & AI: A Deep Conversation with Bart Konieczny

Page: https://stenobird.com/podcast/data-engineering-central-podcast-7106217/spark-lakehouse-ai-a-deep-conversation-with-bart-konieczny
Text version: https://stenobird.com/podcast/data-engineering-central-podcast-7106217/spark-lakehouse-ai-a-deep-conversation-with-bart-konieczny.md
Podcast: [Data Engineering Central Podcast](https://stenobird.com/podcast/data-engineering-central-podcast-7106217)
Published: 2026-02-25T13:10:42+00:00
Episode link: https://dataengineeringcentral.substack.com/p/spark-lakehouse-and-ai-a-deep-conversation
Audio file: https://api.substack.com/feed/podcast/188307251/8fcfe26d8ddfb36c215b61a10a6980f3.mp3
Processing state: not_requested
JSON: https://stenobird.com/v1/public/podcasts/data-engineering-central-podcast-7106217/episodes/spark-lakehouse-ai-a-deep-conversation-with-bart-konieczny
Duration seconds: 2689

## Resource

In this episode of Data Engineering Central, I sit down with Bart Konieczny — data engineer, distributed systems expert, and well-known author in the Data and Spark ecosystem — for a deep technical conversation about modern data engineering. We cover: * How Bart got into tech and distributed systems * His journey through different engineering roles * Spark internals and why they still matter * The realities of lakehouse architecture * Streaming vs batch systems * AI’s impact on data engineering * What engineers should focus on in 2026 In a world obsessed with abstractions and AI tooling, we explore whether understanding the internals is still worth it — or if the game has fundamentally changed. If you’re a data engineer, architect, or platform leader trying to navigate the next phase of the lakehouse era, this one’s for you. Thanks for reading Data Engineering Central! This post is public so feel free to share it. — 🎙️ Data Engineering Central PodcastHosted by Daniel Beach If you’re a CTO or data leader looking for help building or optimizing your data platform, reach out — consulting inquiries welcome. Data Engineering Central is a reader-supported publication. To receive new posts and support my work, consider becoming a free or paid subscriber. This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit dataengineeringcentral.substack.com/subscribe

## Actions

- request_transcript: `POST https://stenobird.com/v1/public/podcasts/data-engineering-central-podcast-7106217/episodes/spark-lakehouse-ai-a-deep-conversation-with-bart-konieczny/transcription-requests` — Idempotently request low-priority transcript generation for this episode.
- read_markdown: `GET https://stenobird.com/podcast/data-engineering-central-podcast-7106217/spark-lakehouse-ai-a-deep-conversation-with-bart-konieczny.md` — Read the agent-friendly Markdown representation of this episode resource.

A page view does not enqueue transcription. Agents should invoke `request_transcript` explicitly when they need this episode processed.

## Transcript

Full transcripts are not published on public pages unless there is a clear rights basis.