# KeyFrame-Compass: Towards Comprehensive Evaluation of Keyframe-Conditioned Video Generation

Page: https://stenobird.com/podcast/daily-paper-cast-7079649/keyframe-compass-towards-comprehensive-evaluation-of-keyframe-conditioned-video-generation
Text version: https://stenobird.com/podcast/daily-paper-cast-7079649/keyframe-compass-towards-comprehensive-evaluation-of-keyframe-conditioned-video-generation.md
Podcast: [Daily Paper Cast](https://stenobird.com/podcast/daily-paper-cast-7079649)
Published: 2026-07-18T03:50:05+00:00
Episode link: https://share.transistor.fm/s/30ad1c1d
Audio file: https://media.transistor.fm/30ad1c1d/b5670364.mp3
Processing state: not_requested
JSON: https://stenobird.com/v1/public/podcasts/daily-paper-cast-7079649/episodes/keyframe-compass-towards-comprehensive-evaluation-of-keyframe-conditioned-video-generation
Duration seconds: 1340

## Resource

🤗 Upvotes: 30 | cs.CV Authors: Yuqi Tang, Tengfei Liu, Yizheng Lai, Yuran Wang, Yang Shi, Wanshun Su, Zhuoran Zhang, Qixun Wang, Xiaohan Zhang, Xinlei Yu, Xuehai Bai, Xuanyu Zhu, Bohan Zeng, Bozhou Li, Shujie Li, Yifan Dai, Yujie Wei, Shixuan Liu, Haotian Wang, Jialu Chen, Yuanxing Zhang Title: KeyFrame-Compass: Towards Comprehensive Evaluation of Keyframe-Conditioned Video Generation Arxiv: http://arxiv.org/abs/2607.14202v1 Abstract: Video generation increasingly relies on keyframe-based workflows, where creators specify a sequence of reference images to guide generation. Although recent models support multi-keyframe conditioning, it remains unclear whether they can faithfully reproduce the prescribed keyframes while maintaining overall video quality. We present KeyFrame-Compass, the first comprehensive benchmark for evaluating keyframe-conditioned video generation. The benchmark contains 386 carefully curated samples spanning three application domains, two video structures, two prompt granularities, two conditioning formats, and four keyframe densities, enabling controlled analysis under diverse generation settings. We further introduce an automated evaluation framework that jointly measures keyframe execution and overall video quality. Specifically, we decompose keyframe execution into six complementary metrics covering presence, fidelity, temporal ordering, localization, persistence, and uniqueness, while assessing overall video quality through evidence-grounded MLLM judgments augmented with specialized perception models. Experiments on nine representative video generation systems reveal several fundamental limitations. Current models exhibit a clear trade-off between faithful keyframe execution and natural video synthesis. Their performance further degrades as key…

## Actions

- request_transcript: `POST https://stenobird.com/v1/public/podcasts/daily-paper-cast-7079649/episodes/keyframe-compass-towards-comprehensive-evaluation-of-keyframe-conditioned-video-generation/transcription-requests` — Idempotently request low-priority transcript generation for this episode.
- read_markdown: `GET https://stenobird.com/podcast/daily-paper-cast-7079649/keyframe-compass-towards-comprehensive-evaluation-of-keyframe-conditioned-video-generation.md` — Read the agent-friendly Markdown representation of this episode resource.

A page view does not enqueue transcription. Agents should invoke `request_transcript` explicitly when they need this episode processed.

## Transcript

Full transcripts are not published on public pages unless there is a clear rights basis.