# CiteVQA: Benchmarking Evidence Attribution for Trustworthy Document Intelligence

Page: https://stenobird.com/podcast/daily-paper-cast-7079649/citevqa-benchmarking-evidence-attribution-for-trustworthy-document-intelligence
Text version: https://stenobird.com/podcast/daily-paper-cast-7079649/citevqa-benchmarking-evidence-attribution-for-trustworthy-document-intelligence.md
Podcast: [Daily Paper Cast](https://stenobird.com/podcast/daily-paper-cast-7079649)
Published: 2026-05-19T04:21:59+00:00
Episode link: https://share.transistor.fm/s/95291574
Audio file: https://media.transistor.fm/95291574/aa2495f0.mp3
Processing state: not_requested
JSON: https://stenobird.com/v1/public/podcasts/daily-paper-cast-7079649/episodes/citevqa-benchmarking-evidence-attribution-for-trustworthy-document-intelligence
Duration seconds: 1390

## Resource

🤗 Upvotes: 164 | cs.CL, cs.CV Authors: Dongsheng Ma, Jiayu Li, Zhengren Wang, Yijie Wang, Jiahao Kong, Weijun Zeng, Jutao Xiao, Jie Yang, Wentao Zhang, Bin Wang, Conghui He Title: CiteVQA: Benchmarking Evidence Attribution for Trustworthy Document Intelligence Arxiv: http://arxiv.org/abs/2605.12882v1 Abstract: Multimodal Large Language Models (MLLMs) have significantly advanced document understanding, yet current Doc-VQA evaluations score only the final answer and leave the supporting evidence unchecked. This answer-only approach masks a critical failure mode: a model can land on the correct answer while grounding it in the wrong passage -- a critical risk in high-stakes domains like law, finance, and medicine, where every conclusion must be traceable to a specific source region. To address this, we introduce CiteVQA, a benchmark that requires models to return element-level bounding-box citations alongside each answer, evaluating both jointly. CiteVQA comprises 1,897 questions across 711 PDFs spanning seven domains and two languages, averaging 40.6 pages per document. To ensure fidelity and scalability, the ground-truth citations are generated by an automated pipeline-which identifies crucial evidence via masking ablation-and are subsequently validated through expert review. At the core of our evaluation is Strict Attributed Accuracy (SAA), which credits a prediction only when the answer and the cited region are both correct. Auditing 20 MLLMs reveals a pervasive Attribution Hallucination: models frequently produce the right answer while citing the wrong region. The strongest system (Gemini-3.1-Pro-Preview) achieves an SAA of only 76.0, and the strongest open-source MLLM reaches just 22.5. Ultimately, towards trustworthy document intelligence, CiteVQA exposes a reliabi…

## Actions

- request_transcript: `POST https://stenobird.com/v1/public/podcasts/daily-paper-cast-7079649/episodes/citevqa-benchmarking-evidence-attribution-for-trustworthy-document-intelligence/transcription-requests` — Idempotently request low-priority transcript generation for this episode.
- read_markdown: `GET https://stenobird.com/podcast/daily-paper-cast-7079649/citevqa-benchmarking-evidence-attribution-for-trustworthy-document-intelligence.md` — Read the agent-friendly Markdown representation of this episode resource.

A page view does not enqueue transcription. Agents should invoke `request_transcript` explicitly when they need this episode processed.

## Transcript

Full transcripts are not published on public pages unless there is a clear rights basis.