Episode
Ep 89: AI Research Legend’s Honest Assessment of Where We Are
- Published
- Jun 3, 2026
- Duration seconds
- 4413
- Processing state
not_requested
Actions
POST https://stenobird.com/v1/public/podcasts/unsupervised-learning-with-jacob-effron-6041643/episodes/ep-89-ai-research-legend-s-honest-assessment-of-where-we-are/transcription-requests
Idempotently request low-priority transcript generation for this episode.GET https://stenobird.com/podcast/unsupervised-learning-with-jacob-effron-6041643/ep-89-ai-research-legend-s-honest-assessment-of-where-we-are.md
Read the agent-friendly Markdown representation of this episode resource.
Summary
This episode with Lukasz Kaiser, co-author of the seminal "Attention Is All You Need" transformer paper and former researcher at both Google Brain and OpenAI, is a wide-ranging conversation about the fundamental limits of current AI architectures and whether transformers will continue to dominate or eventually give way to something new. Lukasz brings a rare dual perspective: deep belief in how far the current paradigm has taken us (he's an enthusiastic daily Codex user who's seen 10x productivity gains in his own research), while maintaining genuine intellectual humility about whether transformers can truly generalize the way humans do. The episode weaves together questions about data efficiency, the non-verifiable RL frontier, the coding agent revolution, the open vs. closed source gap, and what the next architectural leap might look like: all filtered through the lens of someone who helped build the foundation the entire field is standing on.