Episode

The Bitter Lesson: The history of reinforcement learning

Podcast
CoRecursive: Coding Stories
Published
Jun 13, 2026
Duration seconds
3601
Processing state
not_requested
Canonical source
https://corecursive.com/the-bitter-lesson/
Audio
https://traffic.libsyn.com/secure/corecursive/reward-is-enough.mp3?dest-id=628353
JSON
/v1/public/podcasts/corecursive-coding-stories/episodes/the-bitter-lesson-the-history-of-reinforcement-learning
Markdown
/podcast/corecursive-coding-stories/the-bitter-lesson-the-history-of-reinforcement-learning.md

Actions

  • POST https://stenobird.com/v1/public/podcasts/corecursive-coding-stories/episodes/the-bitter-lesson-the-history-of-reinforcement-learning/transcription-requests
    Idempotently request low-priority transcript generation for this episode.
  • GET https://stenobird.com/podcast/corecursive-coding-stories/the-bitter-lesson-the-history-of-reinforcement-learning.md
    Read the agent-friendly Markdown representation of this episode resource.

Summary

I've been trying to understand how machine learning actually works. Not use it, understand it, down to the ifs and loops. How does a program built out of plain conditionals get better on its own? So late one night I sent Don a paper. Three words in the title: reward is enough. The claim is that all of intelligence, the whole thing, comes down to a system maximizing a reward. Don thought that was far too reductive. I wanted to pull it apart and see if it held up. We backed up through the history to find out how far "reward is enough" really goes: B.F. Skinner training pigeons, a backgammon program that taught itself, the Go move no human would have played. It's a story about machine learning, and what that leaves for the rest of us who still do it by hand. Episode Page Support The Show Subscribe To The Podcast Join The Newsletter