Episode
Data Platform Innovation: Navigating Challenges and Building a Unified Experience - ML 147
- Published
- Apr 11, 2024
- Duration seconds
- 3985
- Processing state
failed
Actions
POST https://stenobird.com/v1/public/podcasts/adventures-in-machine-learning/episodes/data-platform-innovation-navigating-challenges-and-building-a-unified-experience-ml-147/transcription-requests
Idempotently request low-priority transcript generation for this episode.GET https://stenobird.com/podcast/adventures-in-machine-learning/data-platform-innovation-navigating-challenges-and-building-a-unified-experience-ml-147.md
Read the agent-friendly Markdown representation of this episode resource.
Summary
Nick Schrock is the Founder of Dagster Labs. He is also the Creator of Dagster and the Co-creator of GraphQL. They delve into the world of data engineering, software development, and ML orchestration. In today's episode, they explore the challenges and intricacies of standardizing data movement, handling data access in various systems, and migrating data across different platforms. They share insights on the importance of building a system that spans multiple data platforms, the decision-making process behind tool development, and the impact of lineage in managing and migrating data. Join them as they uncover the complexities of open-source projects, API evolution, and the future of data engineering. Sponsors Chuck's Resume Template Developer Book Club Become a Top 1% Dev with a Top End Devs Membership Socials LinkedIn: Nick Schrock Become a supporter of this podcast: https://www.spreaker.com/podcast/adventures-in-machine-learning--6102041/support .