{"podcast":{"title":"Screaming in the Cloud","slug":"screaming-in-the-cloud","podcast_index_feed_id":512714,"rss_url":"https://feeds.transistor.fm/screaming-in-the-cloud","website_url":"https://screaminginthecloud.com","image_url":"https://img.transistorcdn.com/sjY7QBiTinCDr8X80gOsgDaM4fMY0WuZn87UxNTh6Fw/rs:fill:0:0:1/w:1400/h:1400/q:60/mb:500000/aHR0cHM6Ly9pbWct/dXBsb2FkLXByb2R1/Y3Rpb24udHJhbnNp/c3Rvci5mbS9zaG93/LzE0OTQvMTU4Mzg2/OTQ4My1hcnR3b3Jr/LmpwZw.jpg","author":"Corey Quinn","episode_count":673,"summary":"Screaming in the Cloud with Corey Quinn features conversations with domain experts in the world of Cloud Computing. Topics discussed include AWS, GCP, Azure, Oracle Cloud, and the \"why\" behind how businesses are coming to think about the Cloud.","last_synced_at":null,"page_url":"https://stenobird.com/podcast/screaming-in-the-cloud"},"episode":{"title":"Solving the 20-Year S3 File System Problem with Hunter Leath","slug":"solving-the-20-year-s3-file-system-problem-with-hunter-leath","published_at":"2026-01-20T11:00:00+00:00","page_url":"https://stenobird.com/podcast/screaming-in-the-cloud/solving-the-20-year-s3-file-system-problem-with-hunter-leath","show_page_url":"https://stenobird.com/podcast/screaming-in-the-cloud","url":"https://share.transistor.fm/s/87694d04","audio_url":"https://dts.podtrac.com/redirect.mp3/media.transistor.fm/87694d04/81e22e5b.mp3","summary":"Archil solves the long-standing problem of using S3 as a high-performance file system by implementing a high-speed SSD cache layer. This approach allows legacy applications to use S3 with POSIX compatibility and significantly lower costs than EBS or EFS.","meta_description":"Learn how Archil transforms S3 buckets into high-performance, POSIX-compatible file systems to reduce cloud storage costs and improve data access speeds.","key_points":["Main idea: Archil acts as a pull-through cache, using fast SSDs to bridge the performance gap between S3 and local disk semantics","Practical takeaway: Users can attach Archil directly to existing S3 buckets without migrating data, maintaining S3 as the source of truth","Economic advantage: When accounting for over-provisioning, Archil can cost approximately 1.95 cents per GB, significantly cheaper than EBS","Failure mode: Traditional attempts to mount S3 as a file system often fail due to high latency and excessive metadata operations (e.g., shell profile reads)","Future roadmap: The project is currently built on FUSE to allow rapid iteration but aims to move into the Linux kernel as a stable module"],"chapters":[{"start_ms":210000,"title":"The Vision for Archil","summary":"Hunter Leath explains the mission to provide EFS-like experiences without the high cost of Amazon's managed services."},{"start_ms":345000,"title":"Why S3 Mounting Fails","summary":"A look at the technical hurdles of legacy software making thousands of discrete read operations against high-latency object storage."},{"start_ms":630000,"title":"The SSD Cache Layer","summary":"How using fast SSDs as a cache layer enables high-performance workloads like video transcoding and AI training."},{"start_ms":760000,"title":"Integration with Existing Buckets","summary":"Details on how Archil attaches to existing production S3 buckets and synchronizes changes back to the source."},{"start_ms":900000,"title":"The Economics of Archil vs EBS","summary":"A mathematical comparison showing how Archil's pricing beats EBS by eliminating the need for over-provisioning."},{"start_ms":1170000,"title":"Competing with AWS Features","summary":"Discussion on the competitive landscape and the risk of AWS introducing similar caching features."},{"start_ms":1750000,"title":"Moving Toward the Linux Kernel","summary":"The technical roadmap from FUSE-based implementation to a mainline Linux kernel module."}],"topics":["Cloud Storage","Amazon S3","File Systems","AWS EFS","Infrastructure Engineering","Data Caching","Cloud Economics","Linux Kernel"],"duration_seconds":1903,"processing_state":"processed","actions":[{"name":"request_transcript","method":"POST","url":"https://stenobird.com/v1/public/podcasts/screaming-in-the-cloud/episodes/solving-the-20-year-s3-file-system-problem-with-hunter-leath/transcription-requests","description":"Idempotently request low-priority transcript generation for this episode."},{"name":"read_markdown","method":"GET","url":"https://stenobird.com/podcast/screaming-in-the-cloud/solving-the-20-year-s3-file-system-problem-with-hunter-leath.md","description":"Read the agent-friendly Markdown representation of this episode resource."}]}}