Episode
Scaling Up Test-Time Compute with Latent Reasoning with Jonas Geiping - #723
- Published
- Mar 17, 2025
- Duration seconds
- 3518
- Processing state
failed
Actions
POST https://stenobird.com/v1/public/podcasts/twiml-ai-podcast/episodes/scaling-up-test-time-compute-with-latent-reasoning-with-jonas-geiping-723/transcription-requests
Idempotently request low-priority transcript generation for this episode.GET https://stenobird.com/podcast/twiml-ai-podcast/scaling-up-test-time-compute-with-latent-reasoning-with-jonas-geiping-723.md
Read the agent-friendly Markdown representation of this episode resource.
Summary
Today, we're joined by Jonas Geiping, research group leader at Ellis Institute and the Max Planck Institute for Intelligent Systems to discuss his recent paper, “Scaling up Test-Time Compute with Latent Reasoning: A Recurrent Depth Approach.” This paper proposes a novel language model architecture which uses recurrent depth to enable “thinking in latent space.” We dig into “internal reasoning” versus “verbalized reasoning”—analogous to non-verbalized and verbalized thinking in humans, and discuss how the model searches in latent space to predict the next token and dynamically allocates more compute based on token difficulty. We also explore how the recurrent depth architecture simplifies LLMs, the parallels to diffusion models, the model's performance on reasoning tasks, the challenges of comparing models with varying compute budgets, and architectural advantages such as zero-shot adaptive exits and natural speculative decoding. The complete show notes for this episode can be found at https://twimlai.com/go/723.