Episode
Echo-Memory: A Controlled Study of Memory in Action World Models
- Podcast
- Daily Paper Cast
- Published
- Jun 10, 2026
- Duration seconds
- 1280
- Processing state
not_requested- Canonical source
- https://share.transistor.fm/s/a1d42248
Actions
POST https://stenobird.com/v1/public/podcasts/daily-paper-cast-7079649/episodes/echo-memory-a-controlled-study-of-memory-in-action-world-models/transcription-requests
Idempotently request low-priority transcript generation for this episode.GET https://stenobird.com/podcast/daily-paper-cast-7079649/echo-memory-a-controlled-study-of-memory-in-action-world-models.md
Read the agent-friendly Markdown representation of this episode resource.
Summary
🤗 Upvotes: 29 | cs.CV, cs.GR, cs.LG Authors: Wayne King, Zeyue Xue, Yuxuan Bian, Jie Huang, Haoran Li, Yaowei Li, Yaofeng Su, Yuming Li, Haoyu Wang, Shiyi Zhang, Songchun Zhang, Yuwei Niu, Sihan Xu, Junhao Zhuang, Haoyang Huang, Nan Duan Title: Echo-Memory: A Controlled Study of Memory in Action World Models Arxiv: http://arxiv.org/abs/2606.09803v1 Abstract: We present \textbf{Echo-Memory}, a controlled study of memory mechanisms in action-conditioned world models. These models generate multi-segment videos from a first frame, text prompt, and camera-action sequence, but their central failure is often memory rather than local image synthesis: after the camera leaves and returns, the scene or salient object may silently change. Existing memory designs are hard to compare because gains are entangled with backbone, training, retrieval, and evaluation differences. Echo-Memory fixes the action-to-video interface and varies only how history is stored and read by the generator. Under a shared video diffusion backbone, optimizer, camera-action representation, sampler, and evaluation pipeline, we compare raw context, compression-based memory, spatial summaries with different read-out paths, and state-space recurrence. This matched matrix separates four otherwise conflated axes: \emph{capacity}, \emph{compression}, \emph{read-out}, and \emph{recurrence}. We also evaluate memory through a three-branch protocol: replay quality, in-domain loop revisit, and open-domain return probes. The branches routinely disagree, showing that replay fidelity is not a sufficient proxy for remembering a world. Three findings follow. Raw context is a strong capacity baseline and improves open-domain return far more than it improves replay metrics. Compactness is not a free substitute for capacity: a…