Episode
Video-MME-Logical: A Controlled Diagnostic Benchmark for Video Temporal-Logical Reasoning
- Podcast
- Daily Paper Cast
- Published
- Jul 1, 2026
- Duration seconds
- 1240
- Processing state
not_requested- Canonical source
- https://share.transistor.fm/s/ff30966b
Actions
POST https://stenobird.com/v1/public/podcasts/daily-paper-cast-7079649/episodes/video-mme-logical-a-controlled-diagnostic-benchmark-for-video-temporal-logical-reasoning/transcription-requests
Idempotently request low-priority transcript generation for this episode.GET https://stenobird.com/podcast/daily-paper-cast-7079649/video-mme-logical-a-controlled-diagnostic-benchmark-for-video-temporal-logical-reasoning.md
Read the agent-friendly Markdown representation of this episode resource.
Summary
🤗 Upvotes: 23 | cs.CV Authors: Hohin Kwan, Hongyu Li, Ray Zhang, Manyuan Zhang, Xianghao Kong, Anyi Rao, Jiahao Xie, Si Liu Title: Video-MME-Logical: A Controlled Diagnostic Benchmark for Video Temporal-Logical Reasoning Arxiv: http://arxiv.org/abs/2606.27828v1 Abstract: Recent interest in multimodal large language models (MLLMs) raises a central question: can they reason over dynamic visual evidence rather than merely recognize objects or events in individual frames? This ability, which we refer to as video temporal-logical reasoning, requires models to maintain, update, and compose evidence as visual states evolve across frames. Existing video benchmarks often conflate this capability with scene complexity, static recognition, or uncontrolled temporal variation. To isolate this capability, we introduce Video-MME-Logical, a controlled benchmark organized around five temporal-logical operations: state tracking, sequential counting, temporal ordering, dynamic spatiality, and structural composition. The benchmark contains 25 fine-grained task categories generated with controlled object states, transitions, temporal dependencies, and logical compositions. It enables difficulty-controlled final-answer evaluation by varying temporal horizon and reasoning complexity, and supports intermediate-state diagnostics by verifying whether models recover the required logical reasoning trace before producing the final answer. Experiments with state-of-the-art MLLMs reveal a substantial human-model gap, especially as temporal-logical complexity increases. Supervised fine-tuning on up to 500K generated samples improves performance but remains insufficient to close the reasoning gap, positioning Video-MME-Logical as a scalable testbed for analyzing and improving temporal-logical reasonin…