# Roger & DJ β€” The Rise of Big Data and CA's COVID-19 Response Page: https://stenobird.com/podcast/gradient-dissent/roger-dj-the-rise-of-big-data-and-ca-s-covid-19-response Text version: https://stenobird.com/podcast/gradient-dissent/roger-dj-the-rise-of-big-data-and-ca-s-covid-19-response.md Podcast: [Gradient Dissent: Conversations on AI](https://stenobird.com/podcast/gradient-dissent) Published: 2021-07-08T19:00:00+00:00 Episode link: https://wandb.ai/site/resources/podcast Audio file: https://podcasts.captivate.fm/media/a4600a89-dc8a-4ea6-bad5-1bd6d91065f4/1068496090-wandb-gd-roger-and-dj.mp3 Processing state: failed JSON: https://stenobird.com/v1/public/podcasts/gradient-dissent/episodes/roger-dj-the-rise-of-big-data-and-ca-s-covid-19-response Duration seconds: 3893 ## Resource Roger and DJ share some of the history behind data science as we know it today, and reflect on their experiences working on California's COVID-19 response. --- Roger Magoulas is Senior Director of Data Strategy at Astronomer, where he works on data infrastructure, analytics, and community development. Previously, he was VP of Research at O'Reilly and co-chair of O'Reilly's Strata Data and AI Conference. DJ Patil is a board member and former CTO of Devoted Health, a healthcare company for seniors. He was also Chief Data Scientist under the Obama administration and the Head of Data Science at LinkedIn. Roger and DJ recently volunteered for the California COVID-19 response, and worked with data to understand case counts, bed capacities and the impact of intervention. Connect with Roger and DJ: πŸ“ Roger's Twitter: https://twitter.com/rogerm πŸ“ DJ's Twitter: https://twitter.com/dpatil --- 🌟 Transcript: http://wandb.me/gd-roger-and-dj 🌟 ⏳ Timestamps: 0:00 Sneak peek, intro 1:03 Coining the terms "big data" and "data scientist" 7:12 The rise of data science teams 15:28 Big Data, Hadoop, and Spark 23:10 The importance of using the right tools 29:20 BLUF: Bottom Line Up Front 34:44 California's COVID response 41:21 The human aspects of responding to COVID 48:33 Reflecting on the impact of COVID interventions 57:06 Advice on doing meaningful data science work 1:04:18 Outro πŸ€ Links: 1. "MapReduce: Simplified Data Processing on Large Clusters" (Dean and Ghemawat, 2004): https://research.google/pubs/pub62/ο»Ώο»Ώ 2. "Big Data: Technologies and Techniques for Large-Scale Data" (Magoulas and Lorica, 2009): https://academics.uccs.edu/~ooluwada/courses/datamining/ExtraReading/BigData 3. The O'RLY book covers: https://www.businessinsider.com/these-hilarious-memes-perfectly-capture-what-its-lik… ## Actions - request_transcript: `POST https://stenobird.com/v1/public/podcasts/gradient-dissent/episodes/roger-dj-the-rise-of-big-data-and-ca-s-covid-19-response/transcription-requests` β€” Idempotently request low-priority transcript generation for this episode. - read_markdown: `GET https://stenobird.com/podcast/gradient-dissent/roger-dj-the-rise-of-big-data-and-ca-s-covid-19-response.md` β€” Read the agent-friendly Markdown representation of this episode resource. A page view does not enqueue transcription. Agents should invoke `request_transcript` explicitly when they need this episode processed. ## Transcript Full transcripts are not published on public pages unless there is a clear rights basis.