# How Braintrust uses AI agents, evals, and CI to ship better software | Ankur Goyal

Page: https://stenobird.com/podcast/how-i-ai-7304222/how-braintrust-uses-ai-agents-evals-and-ci-to-ship-better-software-ankur-goyal
Text version: https://stenobird.com/podcast/how-i-ai-7304222/how-braintrust-uses-ai-agents-evals-and-ci-to-ship-better-software-ankur-goyal.md
Podcast: [How I AI](https://stenobird.com/podcast/how-i-ai-7304222)
Published: 2026-06-15T11:00:00+00:00
Episode link: https://podcasters.spotify.com/pod/show/pen-name/episodes/How-Braintrust-uses-AI-agents--evals--and-CI-to-ship-better-software--Ankur-Goyal-e3kh936
Audio file: https://anchor.fm/s/1035b1568/podcast/play/121201190/https%3A%2F%2Fd3ctxlq1ktw2nl.cloudfront.net%2Fstaging%2F2026-5-9%2F425771285-44100-2-d91dab8395c07.mp3
Processing state: not_requested
JSON: https://stenobird.com/v1/public/podcasts/how-i-ai-7304222/episodes/how-braintrust-uses-ai-agents-evals-and-ci-to-ship-better-software-ankur-goyal
Duration seconds: 2411

## Resource

In this episode, I sit down with Ankur Goyal , founder and CEO of Braintrust, the AI evals and observability platform used by teams like Notion, Stripe, Vercel, and Zapier. This one is for the senior engineers, staff engineers, VPs of engineering, and CTOs in my audience. We get into how coding agents can take on deeply technical architecture and infrastructure work that no single human engineer could tackle before, and then we demystify evals so you can use them to make your AI products better without touching the implementation. What you’ll learn: How Ankur uses Codex to run week-long benchmark experiments across database indexes, column store formats, and execution engines to speed up slow queries Why he argues there’s no excuse to skip rigorous benchmarking now that agents can run them tirelessly The “agent line” framework: how to decide which decisions, directions, and interactions you can hand off to an agent How I think about the practical vs. theoretical quality of AI on hard technical problems, and why human attention decays on tedious work Why evals are the modern version of a PRD, and how to encode “what good looks like” so a model can figure out the “how” How to build a scoring function live and let an agent improve your prompt inside a safe playground How Ankur turned his designer David’s taste into a repeatable eval so quality scales beyond one person Why fixing your CI is the highest-leverage way to speed up engineering velocity — Brought to you by: Guru —The AI layer of truth Persona —Trusted identity verification for any use case — In this episode, we cover: (00:00) Introduction to Ankur Goyal (03:00) Using AI agents for database optimization (06:10) Running exhaustive benchmarks with coding agents (09:03) Why staff engineers are wrong about AI limitat…

## Actions

- request_transcript: `POST https://stenobird.com/v1/public/podcasts/how-i-ai-7304222/episodes/how-braintrust-uses-ai-agents-evals-and-ci-to-ship-better-software-ankur-goyal/transcription-requests` — Idempotently request low-priority transcript generation for this episode.
- read_markdown: `GET https://stenobird.com/podcast/how-i-ai-7304222/how-braintrust-uses-ai-agents-evals-and-ci-to-ship-better-software-ankur-goyal.md` — Read the agent-friendly Markdown representation of this episode resource.

A page view does not enqueue transcription. Agents should invoke `request_transcript` explicitly when they need this episode processed.

## Transcript

Full transcripts are not published on public pages unless there is a clear rights basis.