Episode
Nested Learning: Ali Behrouz on the Quest for Continual Learning & Illusion of AI Architectures
- Published
- Jun 3, 2026
- Duration seconds
- 10803
- Processing state
not_requested
Actions
POST https://stenobird.com/v1/public/podcasts/the-cognitive-revolution/episodes/nested-learning-ali-behrouz-on-the-quest-for-continual-learning-illusion-of-ai-architectures/transcription-requests
Idempotently request low-priority transcript generation for this episode.GET https://stenobird.com/podcast/the-cognitive-revolution/nested-learning-ali-behrouz-on-the-quest-for-continual-learning-illusion-of-ai-architectures.md
Read the agent-friendly Markdown representation of this episode resource.
Summary
Ali Behrouz, grad student at Cornell and Google researcher, discusses his potentially transformative work on new architectures for continual learning in AI. His paper "Nested Learning," praised by Jeff Dean as a possible paradigm shift, enables models to adapt to new context while preserving core knowledge by updating different layers at different frequencies, inspired by human memory systems. The conversation also covers his latest work on AI "sleep" for memory consolidation, why he sees all deep learning as associative memory, and the profound implications of continual learning for privacy, alignment, and the path to AGI. Mercury: The fintech trusted by ambitious companies and individuals to run their finances, with virtual cards, spending limits, merchant/category locks, and AI-friendly tools like API keys, MCP, and CLI. Check out Mercury at mercury.com Sponsor: Claude: Claude by Anthropic is an AI collaborator that understands your workflow and helps you tackle research, writing, coding, and organization with deep context. Get started with Claude and explore Claude Pro at https://claude.ai/tcr