Episode
Concurrent Image Understanding and Generation: Self-Correcting Coupled Markov Jump Processes
- Podcast
- Daily Paper Cast
- Published
- Jul 18, 2026
- Duration seconds
- 1300
- Processing state
not_requested- Canonical source
- https://share.transistor.fm/s/d8d98877
Actions
POST https://stenobird.com/v1/public/podcasts/daily-paper-cast-7079649/episodes/concurrent-image-understanding-and-generation-self-correcting-coupled-markov-jump-processes/transcription-requests
Idempotently request low-priority transcript generation for this episode.GET https://stenobird.com/podcast/daily-paper-cast-7079649/concurrent-image-understanding-and-generation-self-correcting-coupled-markov-jump-processes.md
Read the agent-friendly Markdown representation of this episode resource.
Summary
🤗 Upvotes: 23 | cs.LG Authors: Minh-Quan Le, Armand Comas, Alexandros Lattas, Stylianos Moschoglou, Pedro Vélez, Amit Raj, Aaron Germuth, Thabo Beeler, Dimitris Samaras, Di Qiu Title: Concurrent Image Understanding and Generation: Self-Correcting Coupled Markov Jump Processes Arxiv: http://arxiv.org/abs/2607.13188v1 Abstract: Human cognition does not separate understanding and generation. A teacher at a whiteboard speaks and draws $\textit{together}$, each modality reshapes the other. In this paper, we bring this coupled loop to artificial systems. Masked Diffusion Models (MDMs) are ideally suited to this task, yet existing samplers either decode text and image interleavedly or independently update them in parallel branches that share only previous-step history, but not the other modality's latest decisions $\textit{within}$ the same step; combined with MDMs' inability to remask, cross-modal contradictions are neither detected nor repaired. We introduce $\textbf{Self-Correcting Coupled Markov Jump Processes (SC-CMJP)}$, a framework in which one modality's transition rates are functionals of the other modality's confidence score, as weighted by cross-modal attention. Furthermore, a remasking jump retracts commitments the moment cross-modal evidence turns against them. In conjunction with SC-CMJP, we introduce $\texttt{CO}_\texttt{2}\texttt{Jump}$ (Self-$\underline{\text{CO}}$rrecting $\underline{\text{CO}}$upled $\underline{\text{Jump}}$), a novel training-free single-pass sampler for joint multimodal geneneration. For training and evaluation purposes, we have created and will release three large-scale joint multimodal generation corpora: $\text{JEdit-1M}$, $\text{JMaze-200K}$, $\text{JNono-200K}$, with matching in- and out-of-distribution benchmarks. $\texttt{CO}_\text…