# The best AI agents are simpler than you think | Ben Tannyhill, LangChain

Page: https://stenobird.com/podcast/max-agency-7807113/the-best-ai-agents-are-simpler-than-you-think-ben-tannyhill-langchain
Text version: https://stenobird.com/podcast/max-agency-7807113/the-best-ai-agents-are-simpler-than-you-think-ben-tannyhill-langchain.md
Podcast: [Max Agency](https://stenobird.com/podcast/max-agency-7807113)
Published: 2026-07-02T14:00:00+00:00
Episode link: https://podcasters.spotify.com/pod/show/supermix2/episodes/The-best-AI-agents-are-simpler-than-you-think--Ben-Tannyhill--LangChain-e3li4hf
Audio file: https://anchor.fm/s/1112ba400/podcast/play/122277871/https%3A%2F%2Fd3ctxlq1ktw2nl.cloudfront.net%2Fstaging%2F2026-6-2%2F427212075-44100-2-b7d814047921b.mp3
Processing state: not_requested
JSON: https://stenobird.com/v1/public/podcasts/max-agency-7807113/episodes/the-best-ai-agents-are-simpler-than-you-think-ben-tannyhill-langchain
Duration seconds: 3013

## Resource

Ben Tannyhill is a product manager at LangChain, where he's building LangSmith Engine—an agent that finds and fixes your agent's failures. Engine continuously analyzes your production traces, clusters them into actionable issues, and opens pull requests to fix them. Engine's architecture is a lot like an org chart: a main model delegating to a team of cheaper, faster sub-agents. It launched in public beta at Interrupt 2026, and in this conversation, Ben unpacks why it uses a sandbox as a tool, how the team turned it into a self-improving agent that learns from its own traces, and the hard problem of testing a fix before it ships. – We also discuss: Why Engine is "the agent for agent engineers" Making LangSmith agent-native with condensed trace views Why the team keeps handing more control to the agent Inside Engine's four sub-agents: the screener, verifier, and more Giving Engine memory with an agent overview document How to keep an always-on agent from blowing the inference budget Where Insights, Polly, and Engine are converging – Timestamps: (00:00) Introduction (01:25) LangSmith 101 (02:22) Why Engine is "the agent for agent engineers" (03:49) Under the hood: Engine is a deep agent (06:08) Clustering millions of traces with condensed views (10:10) Why the team keeps handing more control to the agent (13:21) Why Engine uses a sandbox as a tool (14:11) Engine's four sub-agents and the org-chart analogy (16:51) Evals for Engine: IssueBench, Harbor, and synthetic environments (23:05) How Engine evolved: from noisy PRs to an issue inbox (25:56) Inside Engine's memory: the agent overview document (29:25) How to keep an always-on agent from blowing the inference budget (30:52) What models Engine uses (31:30) How Engine was rolled out: from Forge to public beta at Interrupt…

## Actions

- request_transcript: `POST https://stenobird.com/v1/public/podcasts/max-agency-7807113/episodes/the-best-ai-agents-are-simpler-than-you-think-ben-tannyhill-langchain/transcription-requests` — Idempotently request low-priority transcript generation for this episode.
- read_markdown: `GET https://stenobird.com/podcast/max-agency-7807113/the-best-ai-agents-are-simpler-than-you-think-ben-tannyhill-langchain.md` — Read the agent-friendly Markdown representation of this episode resource.

A page view does not enqueue transcription. Agents should invoke `request_transcript` explicitly when they need this episode processed.

## Transcript

Full transcripts are not published on public pages unless there is a clear rights basis.