Episode
GE-Act 2.0: Pretraining and Scaling a World-Action Model for Robotic Manipulation
- Podcast
- Daily Paper Cast
- Published
- Sep 9, 2026
- Duration seconds
- 1206
- Processing state
not_requested- Canonical source
- https://share.transistor.fm/s/38c0118b
Actions
POST https://stenobird.com/v1/public/podcasts/daily-paper-cast-7079649/episodes/ge-act-2-0-pretraining-and-scaling-a-world-action-model-for-robotic-manipulation/transcription-requests
Idempotently request low-priority transcript generation for this episode.GET https://stenobird.com/podcast/daily-paper-cast-7079649/ge-act-2-0-pretraining-and-scaling-a-world-action-model-for-robotic-manipulation.md
Read the agent-friendly Markdown representation of this episode resource.
Summary
🤗 Upvotes: 37 | cs.RO, cs.CV Authors: AgiBot Research Team, Renhang Liu, Wenzhi Zhao, Zhuo Yang, Liliang Chen, Pengfei Zhou, Shengcong Chen, Guanghui Ren, Youlun Peng, Rongjun Jin, Nan Wang, Sukai Wang, Xindong He, Jinyuan Feng, Ziyu Xiong, Linqing Zhong, Yifei Wei, Feng Han, Long Zhang, Da Huang, Nanshu Zhao, Chenghao Yin, Mo Wu, Zhaodong Yan, Kongtao Hu, Yuxiang Yan, Aogelijiang Niyazi, Yu Fang, Jia Zeng, Lizhu Meng, Daizhen Lv, Haoyu Cao, Zhiwen Hou, Lianjin Ye, Yuehan Niu, Zhikai Cai, Xuan Hu, Hui Min, Xiongfeng Cai, Yue Liao, Jing Wu, Soujanya Poria, Ye Li, Sanping Zhou, Maoqing Yao Title: GE-Act 2.0: Pretraining and Scaling a World-Action Model for Robotic Manipulation Arxiv: http://arxiv.org/abs/2609.05588v1 Abstract: World-action models (WAM) predict future states to guide robot actions, enabling learning from both action-free video and action-labeled interaction. Most inherit pretrained video generators, leaving WAM pretraining and scaling underexplored. We introduce Genie Envisioner Act 2.0 (GE-Act 2.0), a world-action model whose trainable generative and action components are all initialized from scratch on manipulation data. It combines a control-oriented autoencoder (CoAE), a single-step visual planner (SVP), and an inverse dynamics model (IDM). CoAE retains action- and instruction-relevant information under aggressive compression, while SVP produces a complete future state in one differentiable pass, so visual planning and inverse dynamics can be pretrained separately on complementary data. The components are then jointly trained with knowledge-aligned selective optimization (KASO), which reduces mismatched supervision by selecting only predicted futures judged behaviorally compatible with the recorded action. We evaluate pretrained checkpoints directly,…