{"podcast":{"title":"Arrested DevOps","slug":"arrested-devops","podcast_index_feed_id":1039729,"rss_url":"https://www.arresteddevops.com/episode/index.xml","website_url":"https://www.arresteddevops.com/","image_url":"https://www.arresteddevops.com/img/ado-podcast-logo.png","author":"Matt Stratton","episode_count":205,"summary":"Arrested DevOps is the podcast that helps you achieve understanding, develop good practices, and operate your team and organization for maximum DevOps awesomeness.","last_synced_at":null,"page_url":"https://stenobird.com/podcast/arrested-devops"},"episode":{"title":"Data! Data! Data! With Francesco Tisiot","slug":"data-data-data-with-francesco-tisiot","published_at":"2023-06-01T16:07:50+00:00","page_url":"https://stenobird.com/podcast/arrested-devops/data-data-data-with-francesco-tisiot","show_page_url":"https://stenobird.com/podcast/arrested-devops","url":"https://www.arresteddevops.com/data-data-data/","audio_url":"https://media.blubrry.com/arresteddevops/content.blubrry.com/arresteddevops/arrested-devops-podcast-episode186.mp3","summary":"Uncontrolled data growth creates significant security risks and operational debt. This episode explores how to manage data lineage, prevent manual 'Excel-based' workarounds, and build resilient pipelines using technologies like Kafka.","meta_description":"Learn how to manage data lineage, prevent security holes in pipelines, and build trustworthy, scalable data systems with Francesco Tisiot.","key_points":["Failure mode: Allowing unmanaged data pipelines leads to 'shadow' processes and security vulnerabilities like exposed S3 buckets","Practical takeaway: Empowering users with proper tools prevents them from reverting to manual, insecure Excel exports","Main idea: Data lineage and visibility are more critical for scaling than simply implementing the latest shiny technology","Practical takeaway: Use technologies like Kafka to enable data replayability and schema versioning for more resilient systems","Main idea: The real challenge in modern data engineering isn't innovation, but the unglamorous work of data cleansing and management"],"chapters":[{"start_ms":280000,"title":"The Intersection of People and Data","summary":"Francesco discusses his transition from computer science to a role focused on the intersection of technology and human interaction through data."},{"start_ms":490000,"title":"The Data Journey","summary":"An exploration of how data points become valuable assets as they move through various stages of a company's lifecycle."},{"start_ms":1075000,"title":"The Danger of Undocumented Pipelines","summary":"The risks of 'orphaned' data pipelines where the origin, ownership, and cost of data movement become unknown."},{"start_ms":1525000,"title":"Preventing the 'Excel Way'","summary":"How a lack of proper data infrastructure forces engineers into manual, insecure data handling processes."},{"start_ms":1765000,"title":"Leveraging Kafka for Connectivity","summary":"Using Kafka Connect and JSON payloads to parse and link disparate data sources effectively."},{"start_ms":2180000,"title":"Building Trustworthy Systems","summary":"Moving beyond speed to focus on error recovery, reliability, and building trust in data outputs."},{"start_ms":2400000,"title":"The Power of Data Replay","summary":"How Kafka's log retention allows for replaying historical data to support new consumers and schema evolutions."}],"topics":["Data Engineering","Data Lineage","Kafka","Data Governance","Data Pipelines","DevOps","Data Security","Scalability"],"duration_seconds":2793,"processing_state":"processed","actions":[{"name":"request_transcript","method":"POST","url":"https://stenobird.com/v1/public/podcasts/arrested-devops/episodes/data-data-data-with-francesco-tisiot/transcription-requests","description":"Idempotently request low-priority transcript generation for this episode."},{"name":"read_markdown","method":"GET","url":"https://stenobird.com/podcast/arrested-devops/data-data-data-with-francesco-tisiot.md","description":"Read the agent-friendly Markdown representation of this episode resource."}]}}