Episode
"The paper that killed deep learning theory" by LawrenceC
- Published
- Apr 27, 2026
- Duration seconds
- 684
- Processing state
not_requested
Actions
POST https://stenobird.com/v1/public/podcasts/lesswrong-curated-popular-5643401/episodes/the-paper-that-killed-deep-learning-theory-by-lawrencec/transcription-requests
Idempotently request low-priority transcript generation for this episode.GET https://stenobird.com/podcast/lesswrong-curated-popular-5643401/the-paper-that-killed-deep-learning-theory-by-lawrencec.md
Read the agent-friendly Markdown representation of this episode resource.
Summary
Around 10 years ago, a paper came out that arguably killed classical deep learning theory: Zhang et al. 's aptly titled Understanding deep learning requires rethinking generalization. Of course, this is a bit of an exaggeration. No single paper ever kills a field of research on its own, and deep learning theory was not exactly the most productive and healthy field at the time this was published. But if I had to point to a single paper that shattered the feeling of optimism at the time, it ...