Episode
VideoChat3: Fully Open Video MLLM for Efficient and Generalist Video Understanding
- Podcast
- Daily Paper Cast
- Published
- Jul 18, 2026
- Duration seconds
- 1481
- Processing state
not_requested- Canonical source
- https://share.transistor.fm/s/bed89c24
Actions
POST https://stenobird.com/v1/public/podcasts/daily-paper-cast-7079649/episodes/videochat3-fully-open-video-mllm-for-efficient-and-generalist-video-understanding/transcription-requests
Idempotently request low-priority transcript generation for this episode.GET https://stenobird.com/podcast/daily-paper-cast-7079649/videochat3-fully-open-video-mllm-for-efficient-and-generalist-video-understanding.md
Read the agent-friendly Markdown representation of this episode resource.
Summary
🤗 Upvotes: 109 | cs.CV Authors: Xinhao Li, Yuhan Zhu, Xiangyu Zeng, Yuhao Dong, Haoning Wu, Zhiqiu Zhang, Yuandong Yang, Changlian Ma, Qingyu Zhang, Yansong Shi, Xinyu Chen, Haoran Chen, Zizheng Huang, Jun Zhang, Kun Ouyang, Lin Sui, Ziang Yan, Yicheng Xu, Chenting Wang, Yinan He, Hongjie Zhang, Yi Wang, Yu Qiao, Yali Wang, Ziwei Liu, Kai Chen, Limin Wang Title: VideoChat3: Fully Open Video MLLM for Efficient and Generalist Video Understanding Arxiv: http://arxiv.org/abs/2607.14935v1 Abstract: Recent advances in video understanding have spanned motion, long video, and streaming interaction, driving this field toward real-world applications. Despite this progress, current open-source models remain limited in several ways. They often struggle to generalize across diverse video types, making them effective only in specific domains. High computational demands further restrict their efficiency and scalability. Moreover, most models are only partially open, with key components such as training code, strategy, or datasets unavailable, which hinders reproducibility and slows community-driven development. To address these issues, we introduce VideoChat3, a fully open, efficient, and generalist video-centric MLLM. VideoChat3 advances video understanding through two complementary designs. For efficiency, we introduce Inflated 3D Vision Transformer (I3D-ViT) and Adaptive Frame Resolution for Streaming Video Perception, which enables efficient spatiotemporal representation and reduces the cost of processing video inputs during training and inference. For effectiveness, we develop a scalable video data synthesis pipeline that curates three diverse, high-quality training datasets: VideoChat3-Academic2M, VideoChat3-LV116K, and VideoChat3-OL617K, covering general, long-form, and stream…