# $π$-Bench: Evaluating Proactive Personal Assistant Agents in Long-Horizon Workflows

Page: https://stenobird.com/podcast/daily-paper-cast-7079649/bench-evaluating-proactive-personal-assistant-agents-in-long-horizon-workflows
Text version: https://stenobird.com/podcast/daily-paper-cast-7079649/bench-evaluating-proactive-personal-assistant-agents-in-long-horizon-workflows.md
Podcast: [Daily Paper Cast](https://stenobird.com/podcast/daily-paper-cast-7079649)
Published: 2026-05-23T04:28:38+00:00
Episode link: https://share.transistor.fm/s/13d9349a
Audio file: https://media.transistor.fm/13d9349a/6c746bdc.mp3
Processing state: not_requested
JSON: https://stenobird.com/v1/public/podcasts/daily-paper-cast-7079649/episodes/bench-evaluating-proactive-personal-assistant-agents-in-long-horizon-workflows
Duration seconds: 1352

## Resource

🤗 Upvotes: 86 | cs.AI Authors: Haoran Zhang, Luxin Xu, Zhilin Wang, Runquan Gui, Shunkai Zhang, Haodi Lei, Zihao He, Bingsu He, Chicheng Qin, Tong Zhu, Xiaoye Qu, Yang Yang, Yu Cheng, Yafu Li Title: $π$-Bench: Evaluating Proactive Personal Assistant Agents in Long-Horizon Workflows Arxiv: http://arxiv.org/abs/2605.14678v3 Abstract: The rise of personal assistant agents, e.g., OpenClaw, highlights the growing potential of large language models to support users across everyday life and work. A core challenge in these settings is proactive assistance, since users often begin with underspecified requests and leave important needs, constraints, or preferences unstated. However, existing benchmarks rarely evaluate whether agents can identify and act on such hidden intents before they are explicitly stated, especially in sustained multi-turn interactions where user needs emerge gradually. To address this gap, we introduce $π$-Bench, a benchmark for proactive assistance comprising 100 multi-turn tasks across 5 domain-specific user personas. By incorporating hidden user intents, inter-task dependencies, and cross-session continuity, $π$-Bench evaluates agents' ability to anticipate and address user needs over extended interactions, jointly measuring proactivity and task completion in long-horizon trajectories that better reflect real-world use. Experiments show (1) proactive assistance remains challenging, (2) a clear distinction between task completion and proactivity, and (3) the value of prior interaction for proactive intent resolution in later tasks.

## Actions

- request_transcript: `POST https://stenobird.com/v1/public/podcasts/daily-paper-cast-7079649/episodes/bench-evaluating-proactive-personal-assistant-agents-in-long-horizon-workflows/transcription-requests` — Idempotently request low-priority transcript generation for this episode.
- read_markdown: `GET https://stenobird.com/podcast/daily-paper-cast-7079649/bench-evaluating-proactive-personal-assistant-agents-in-long-horizon-workflows.md` — Read the agent-friendly Markdown representation of this episode resource.

A page view does not enqueue transcription. Agents should invoke `request_transcript` explicitly when they need this episode processed.

## Transcript

Full transcripts are not published on public pages unless there is a clear rights basis.