Episode
Ring-Zero: Scaling Zero RL to a Trillion Parameters for Emergent Reasoning
- Podcast
- Daily Paper Cast
- Published
- Jul 17, 2026
- Duration seconds
- 1249
- Processing state
not_requested- Canonical source
- https://share.transistor.fm/s/2692e8a7
Actions
POST https://stenobird.com/v1/public/podcasts/daily-paper-cast-7079649/episodes/ring-zero-scaling-zero-rl-to-a-trillion-parameters-for-emergent-reasoning/transcription-requests
Idempotently request low-priority transcript generation for this episode.GET https://stenobird.com/podcast/daily-paper-cast-7079649/ring-zero-scaling-zero-rl-to-a-trillion-parameters-for-emergent-reasoning.md
Read the agent-friendly Markdown representation of this episode resource.
Summary
🤗 Upvotes: 80 | cs.CL Authors: Xinyu Tang, Qianggang Cao, Yurou Liu, Yuliang Zhan, Xiaochong Lan, Yifan Li, Yuchen Yan, Han Peng, Zican Dong, Zhenduo Zhang, Tianshu Wang, Xinyu Kong, Zujie Wen, Wayne Xin Zhao, Zhiqiang Zhang, Jun Zhou Title: Ring-Zero: Scaling Zero RL to a Trillion Parameters for Emergent Reasoning Arxiv: http://arxiv.org/abs/2607.12395v2 Abstract: Reinforcement learning with verifiable rewards without human-annotated data, often referred to as zero RL, has emerged as a powerful paradigm for eliciting chain-of-thought reasoning. However, due to computational constraints, existing studies are largely restricted to small models, leaving the training dynamics and emergent capabilities at a large scale unexplored. To meaningfully explore this frontier, we aim to elicit high-quality reasoning behaviors from the model. However, we find that naive scaling often suffers from poor readability, token redundancy, and a lack of adaptive reasoning depth. To address these challenges, we present a stable and efficient training pipeline, incorporating algorithmic and system optimizations such as clipped importance sampling, training-inference ratio correction, and mixed-precision control. Our experiments offer three key findings that validate the "bitter lesson" of scaling: (1) scaling to 1T parameters significantly enhances sample efficiency and performance ceilings; (2) the training process progresses sequentially through an initial discovery phase followed by a sharpening phase; and (3) the model spontaneously develops advanced cognitive behaviors, including anthropomorphism, structured formatting, self-verification, parallel reasoning, and context anxiety, rendering hand-crafted heuristics redundant. Evaluated on seven mathematical benchmarks, Ring-2.5-1T-Zero ach…