Episode
RubricEM: Meta-RL with Rubric-guided Policy Decomposition beyond Verifiable Rewards
- Podcast
- Daily Paper Cast
- Published
- May 14, 2026
- Duration seconds
- 1357
- Processing state
not_requested- Canonical source
- https://share.transistor.fm/s/99f378e6
Actions
POST https://stenobird.com/v1/public/podcasts/daily-paper-cast-7079649/episodes/rubricem-meta-rl-with-rubric-guided-policy-decomposition-beyond-verifiable-rewards/transcription-requests
Idempotently request low-priority transcript generation for this episode.GET https://stenobird.com/podcast/daily-paper-cast-7079649/rubricem-meta-rl-with-rubric-guided-policy-decomposition-beyond-verifiable-rewards.md
Read the agent-friendly Markdown representation of this episode resource.
Summary
🤗 Upvotes: 66 | cs.CL, cs.LG Authors: Gaotang Li, Bhavana Dalvi Mishra, Zifeng Wang, Jun Yan, Yanfei Chen, Chun-Liang Li, Long T. Le, Rujun Han, George Lee, Hanghang Tong, Chen-Yu Lee, Tomas Pfister Title: RubricEM: Meta-RL with Rubric-guided Policy Decomposition beyond Verifiable Rewards Arxiv: http://arxiv.org/abs/2605.10899v1 Abstract: Training deep research agents, namely systems that plan, search, evaluate evidence, and synthesize long-form reports, pushes reinforcement learning beyond the regime of verifiable rewards. Their outputs lack ground-truth answers, their trajectories span many tool-augmented decisions, and standard post-training offers little mechanism for turning past attempts into reusable experience. In this work, we argue that rubrics should serve not merely as final-answer evaluators, but as the shared interface that structures policy execution, judge feedback, and agent memory. Based on this view, we introduce RubricEM, a rubric-guided reinforcement learning framework that combines stagewise policy decomposition with reflection-based meta-policy evolution. RubricEM first makes research trajectories stage-aware by conditioning planning, evidence gathering, review, and synthesis on self-generated rubrics. It then assigns credit with Stage-Structured GRPO, which uses stagewise rubric judgments to provide denser semantic feedback for long-horizon optimization. In parallel, RubricEM trains a shared-backbone reflection meta-policy that distills judged trajectories into reusable rubric-grounded guidance for future attempts. The resulting RubricEM-8B achieves strong performance across four long-form research benchmarks, outperforming comparable open models and approaching proprietary deep-research systems. Beyond final performance, we perform thorough ana…