{"podcast":{"title":"CoRecursive: Coding Stories","slug":"corecursive-coding-stories","podcast_index_feed_id":987298,"rss_url":"https://corecursive.libsyn.com/feed","website_url":"http://corecursive.com","image_url":"https://static.libsyn.com/p/assets/d/7/a/5/d7a5a500931246e3/Coding_Stories.png","author":"Adam Gordon Bell - Software Developer","episode_count":116,"summary":"The stories and people behind the code. Hear stories of software development from interesting people.","last_synced_at":"2026-06-14T18:20:04.608497+00:00","page_url":"https://stenobird.com/podcast/corecursive-coding-stories"},"episode":{"title":"The Pre-Training Wall and the Treadmill After It","slug":"the-pre-training-wall-and-the-treadmill-after-it","published_at":"2026-05-09T10:00:00+00:00","page_url":"https://stenobird.com/podcast/corecursive-coding-stories/the-pre-training-wall-and-the-treadmill-after-it","show_page_url":"https://stenobird.com/podcast/corecursive-coding-stories","url":"https://corecursive.com/the-pre-training-wall-and-the-treadmill-after-it/","audio_url":"https://traffic.libsyn.com/secure/corecursive/121.mp3?dest-id=628353","summary":"I've been confusing Don with frontier-lab links late at night for a bit. Ilya Sutskever told a NeurIPS audience that pre-training as we know it would unquestionably end. There's only one internet, and the data isn't growing. The frontier labs call this the pre-training wall. A leaked Google memo from 2023 argued they had no moat. R1 is on GitHub. Llama is on Hugging Face. OpenAI's secondary-market valuation has climbed past $850 billion. Don was confused. So he came over and we made an episode about it. Episode Page Support The Show Subscribe To The Podcast Join The Newsletter","meta_description":"I've been confusing Don with frontier-lab links late at night for a bit. Ilya Sutskever told a NeurIPS audience that pre-training as we know it would unqu…","key_points":[],"chapters":[],"topics":[],"duration_seconds":3370,"processing_state":"not_requested","actions":[{"name":"request_transcript","method":"POST","url":"https://stenobird.com/v1/public/podcasts/corecursive-coding-stories/episodes/the-pre-training-wall-and-the-treadmill-after-it/transcription-requests","description":"Idempotently request low-priority transcript generation for this episode."},{"name":"read_markdown","method":"GET","url":"https://stenobird.com/podcast/corecursive-coding-stories/the-pre-training-wall-and-the-treadmill-after-it.md","description":"Read the agent-friendly Markdown representation of this episode resource."}]}}