Episode
AgenticDataBench: A Comprehensive Benchmark for Data Agents
- Podcast
- Daily Paper Cast
- Published
- Jul 4, 2026
- Duration seconds
- 1298
- Processing state
not_requested- Canonical source
- https://share.transistor.fm/s/cbf201a6
Actions
POST https://stenobird.com/v1/public/podcasts/daily-paper-cast-7079649/episodes/agenticdatabench-a-comprehensive-benchmark-for-data-agents/transcription-requests
Idempotently request low-priority transcript generation for this episode.GET https://stenobird.com/podcast/daily-paper-cast-7079649/agenticdatabench-a-comprehensive-benchmark-for-data-agents.md
Read the agent-friendly Markdown representation of this episode resource.
Summary
🤗 Upvotes: 23 | cs.DB, cs.AI, cs.CL, cs.LG Authors: Zhaoyan Sun, Shan Zhong, Daizhou Wen, Jiaxing Han, Guoliang Li, Ying Yan, Peng Zhang, Yu Su, Xiang Qi, Baolin Sun, Chengyuan Yang, Tao Fang, Huaiyu Ruan Title: AgenticDataBench: A Comprehensive Benchmark for Data Agents Arxiv: http://arxiv.org/abs/2607.01647v1 Abstract: Data science aims to derive actionable insights from heterogeneous raw data, unlocking the value of the massive amounts of data generated in modern society. Automating this process is essential to reducing labor-intensive efforts for data scientists and enabling scalable data-driven applications. Recently, large language model (LLM)-based data agents have emerged as a promising solution to automate data science workflows. However, the field lacks comprehensive benchmarks to rigorously evaluate these agents across diverse scenarios with fine-grained granularity. To address this gap, we propose AgenticDataBench, a comprehensive benchmark featuring realistic tasks spanning diverse domains with fine-grained ground-truth labels. This enables evaluations to capture the diversity and complexity of data science workflows and the detailed performance of agents. First, to cover diverse domains, we collect real datasets and tasks from 15 vertical domains, including 5 real-world B2B use cases from a leading fintech company. Second, to remove redundancy in real-world tasks and generate high-quality tasks for domains lacking real data, we introduce data science skills, recurring data-centric operational patterns, and quantify benchmark coverage by the number of skills included. Representative skills are extracted from large-scale task solutions on Stack Overflow using skill-aligned hierarchical clustering. Third, for real-world business tasks, we select task-solutio…