Stenobird

Episode

#227 - Jeremie is back! DeepSeek 3.2, TPUs, Nested Learning

Podcast
Last Week in AI
Published
Dec 9, 2025
Duration seconds
5680
Processing state
processed
Canonical source
https://rss.art19.com/episodes/f9722eb4-47de-43a6-bd71-fe778fbe8f53.mp3?rss_browser=BAhJIg90cmFuc2NyaWJyBjoGRVQ%3D--952c5701c84ad333c69d5faa668f8177091704f0
Audio
https://rss.art19.com/episodes/f9722eb4-47de-43a6-bd71-fe778fbe8f53.mp3?rss_browser=BAhJIg90cmFuc2NyaWJyBjoGRVQ%3D--952c5701c84ad333c69d5faa668f8177091704f0
JSON
/v1/public/podcasts/last-week-in-ai/episodes/227-jeremie-is-back-deepseek-3-2-tpus-nested-learning
Markdown
/podcast/last-week-in-ai/227-jeremie-is-back-deepseek-3-2-tpus-nested-learning.md

Actions

  • POST https://stenobird.com/v1/public/podcasts/last-week-in-ai/episodes/227-jeremie-is-back-deepseek-3-2-tpus-nested-learning/transcription-requests
    Idempotently request low-priority transcript generation for this episode.
  • GET https://stenobird.com/podcast/last-week-in-ai/227-jeremie-is-back-deepseek-3-2-tpus-nested-learning.md
    Read the agent-friendly Markdown representation of this episode resource.

Summary

The AI landscape is shifting as hardware competition intensifies between NVIDIA, Google's TPUs, and Amazon's new chips. Meanwhile, OpenAI's 'Code Red' internal pivot highlights the growing pressure from rivals like Anthropic and the rise of high-performance open-source models like DeepSeek 3.2.

Topics

  • DeepSeek
  • OpenAI
  • Anthropic
  • NVIDIA
  • Google TPU
  • AI Hardware
  • Large Language Models
  • Generative Video
  • AI Regulation

Highlights

  • Main idea: The emergence of Google's TPU ecosystem and Amazon's new AI chips is creating a significant challenge to NVIDIA's hardware dominance
  • Main idea: OpenAI has declared a 'Code Red' to prioritize ChatGPT improvements in response to rapid advancements from competitors like Anthropic
  • Practical takeaway: Open-source models like DeepSeek 3.2 and Flux.2 are providing high-performance, cost-effective alternatives to closed-source giants
  • Failure mode: OpenAI's shift from a pure R&D lab to a product-focused company may create internal tension between long-term ASI research and immediate product defense
  • Main idea: The geopolitical tension surrounding NVIDIA chip exports to China is increasingly becoming a legislative battleground in the US

Chapters

  1. 8:35 DeepSeek 3.2 and Open-Source Advancements: An analysis of how DeepSeek 3.2 is providing faster and more efficient model capabilities for the open-source community.
  2. 22:45 The Evolution of Pre-training and RL: A discussion on the blurring lines between pre-training, post-training, and the integration of Reinforcement Learning.
  3. 31:05 The Rise of AI Image and Video Models: Exploring the impact of Flux.2 and the demand-driven scaling of models like Nano Banana Pro.
  4. 38:25 The Shift Toward TPU Ecosystems: How Google's TPU dominance and Amazon's new silicon are threatening NVIDIA's market position.
  5. 45:35 OpenAI's 'Code Red' and Competitive Pressure: Examining OpenAI's internal pivot to defend ChatGPT against rising competition from Anthropic and Google.
  6. 53:05 Large-Scale AI Infrastructure and Energy: The logistical and energy challenges of scaling massive AI clusters, such as the 1 GW Stargate project.
  7. 1:08:05 Advanced Memory and Learning Architectures: A deep dive into research regarding multi-frequency updates and memory mechanisms in next-generation models.