Episode

Why Your AI is Still a Demo: Lessons from Braintrust’s Field CTO

Podcast
The Neon Show
Published
May 15, 2026
Duration seconds
2790
Processing state
not_requested
Canonical source
https://www.buzzsprout.com/1601695/episodes/19181302-why-your-ai-is-still-a-demo-lessons-from-braintrust-s-field-cto.mp3
Audio
https://www.buzzsprout.com/1601695/episodes/19181302-why-your-ai-is-still-a-demo-lessons-from-braintrust-s-field-cto.mp3
JSON
/v1/public/podcasts/the-neon-show-862453/episodes/why-your-ai-is-still-a-demo-lessons-from-braintrust-s-field-cto
Markdown
/podcast/the-neon-show-862453/why-your-ai-is-still-a-demo-lessons-from-braintrust-s-field-cto.md

Actions

  • POST https://stenobird.com/v1/public/podcasts/the-neon-show-862453/episodes/why-your-ai-is-still-a-demo-lessons-from-braintrust-s-field-cto/transcription-requests
    Idempotently request low-priority transcript generation for this episode.
  • GET https://stenobird.com/podcast/the-neon-show-862453/why-your-ai-is-still-a-demo-lessons-from-braintrust-s-field-cto.md
    Read the agent-friendly Markdown representation of this episode resource.

Summary

85% of AI teams will hit a serious production failure this year. The only thing separating them from the 15% who don't? Evals. After nearly two decades of building AI systems at Microsoft, Facebook, and Dropbox, Ameya Bhatawdekar is now Field CTO at Braintrust, the AI observability platform used by Airtable, Notion, Stripe, Dropbox, Vercel, Cloudflare, Lovable, and Replit. We discuss a shift that most teams underestimate. The winners in AI are not just shipping faster. They are building syste...