Episode

22: Declarative Infra and Beyond

Podcast
NerdOut@Spotify
Published
Aug 24, 2023
Duration seconds
2672
Processing state
not_requested
Canonical source
https://podcasters.spotify.com/pod/show/engineeringatspotify/episodes/22-Declarative-Infra-and-Beyond-e28ev7l
Audio
https://anchor.fm/s/805682b0/podcast/play/74988213/https%3A%2F%2Fd3ctxlq1ktw2nl.cloudfront.net%2Fstaging%2F2023-7-23%2F2e54c091-d586-831a-b904-87ccd6aae4a5.mp3
JSON
/v1/public/podcasts/nerdout-spotify-4978381/episodes/22-declarative-infra-and-beyond
Markdown
/podcast/nerdout-spotify-4978381/22-declarative-infra-and-beyond.md

Actions

  • POST https://stenobird.com/v1/public/podcasts/nerdout-spotify-4978381/episodes/22-declarative-infra-and-beyond/transcription-requests
    Idempotently request low-priority transcript generation for this episode.
  • GET https://stenobird.com/podcast/nerdout-spotify-4978381/22-declarative-infra-and-beyond.md
    Read the agent-friendly Markdown representation of this episode resource.

Summary

In the very old days, if you needed more storage for your database, you had to walk into the data center and install another server. Now you can just log into your cloud provider’s console and click a few buttons. Voilá, more storage. So easy! But what if you’re replicating that storage configuration for hundreds of databases at once? Suddenly, that’s a lot more clicking. Not so easy! (Plus, very tedious and very error prone.) So instead of living with this “ClickOps” approach, we developed a declarative infrastructure model — our very own “infrastructure as code” solution for managing cloud resources at Spotify scale. Instead of manually configuring each resource, developers just describe the state they want. And once we adopted declarative infra, we unlocked ways to improve not just how we manage resources, but also how we update policies, manage dependencies, and make other changes to code across our entire fleet of repos — quickly, safely, easily. In other words, programmatically. Host Dave Zolotusky talks with David Flemström — who went from pushing the limits of Spotify’s infrastructure as a feature developer to working on the platform team in order to improve infrastructure for all of our developers. The two Daves discuss what declarative infrastructure means at Spotify, our journey to adopting it (going from Puppet to cloud consoles, to something better than both) and why we did it, how our model works (Kubernetes!), how it changed the relationship between our feature teams and our platform teams, how this shift helped enable Fleet Management at Spotify, and where we’re going next with abstracting infrastructure so that it helps our engineers do more, more easily. Learn more about declarative infrastructure and Fleet Management: NerdOut, Episode 12: Fleet First…