{"podcast":{"title":"The Growth Podcast","slug":"the-growth-podcast-6993153","podcast_index_feed_id":6993153,"rss_url":"https://api.substack.com/feed/podcast/454003/s/133669.rss","website_url":"https://www.news.aakashg.com/s/product-growth-podcast","image_url":"https://substackcdn.com/feed/podcast/454003/s/133669/596402a8f2fc2cbe4d2b7f834c4f02eb.jpg","author":"Aakash Gupta","episode_count":148,"summary":"The latest insights into how great products grow, how to be a better PM or product leader, and how to get a PM job.","last_synced_at":"2026-07-21T10:17:39.312468+00:00","page_url":"https://stenobird.com/podcast/the-growth-podcast-6993153"},"episode":{"title":"How to Run Evals in Claude Code with Aparna Dhinakaran, Founder and CPO of Arize","slug":"how-to-run-evals-in-claude-code-with-aparna-dhinakaran-founder-and-cpo-of-arize","published_at":"2026-05-22T21:27:42+00:00","page_url":"https://stenobird.com/podcast/the-growth-podcast-6993153/how-to-run-evals-in-claude-code-with-aparna-dhinakaran-founder-and-cpo-of-arize","show_page_url":"https://stenobird.com/podcast/the-growth-podcast-6993153","url":"https://www.news.aakashg.com/p/aparna-dhinakaran-podcast","audio_url":"https://api.substack.com/feed/podcast/197073936/a8f2def42e54c20999d4d5b249fcf33d.mp3","summary":"Today’s episode Many of the smartest AI teams I know are running their evals on Arize. Teams at Uber, Booking.com, Pepsi, and others. It’s become one of the most important skills for PMs. I already had on the CEO of Braintrust , Hamel Husain and Shreya Shankar , and Ankit Shukla . Today I’m adding to this knowledge base on evals with a masterclass on evals in Claude Code. Aparna Dhinakaran is the founder of Arize. She’s also their CPO. And she gives a masterclass in how to run all of your evals through Claude Code. So if you want to do AI evals like the best, like Uber, like Booking.com, check out this episode. For anyone in building in Claude Code, it’s a doozy. If a candidate did this in an interview, Aparna said she would hire them on the spot. ---- Check out the conversation on Apple , Spotify , and YouTube . Brought to you by: * Superhuman - The fastest email experience ever made * Sign up and get 1-month free of Superhuman Mail with my link: superhuman.com/akash (given by brand - Kartik) * Land PM Job - My 12-week AI PM + Job Search Course, first 10 enrollees get a FREE 30-min 1:1 consultation * Vanta - Automate your compliance. Close deals faster * Product Faculty - Get $550 off their #1 AI PM Certification with code AAKASH550C7 * Bolt - Ship AI-powered products 10x faster ---- If you want access to my AI tool stack - Dovetail, Arize, Linear, Descript, Reforge Build, Relay.app, Magic Patterns, Speechify, and Mobbin - grab Aakash’s bundle . Do you want to become an AI PM? I’ve created a course for you. Starts soon . ---- Key Takeaways: 1. Trace before you eval - A trace is the full step-by-step playback of what your agent did. Without it, you have no evidence base for evals. Every LLM call, every tool call, every intermediate output needs to be visible before you…","meta_description":"Today’s episode Many of the smartest AI teams I know are running their evals on Arize. Teams at Uber, Booking.com, Pepsi, and others. It’s become one of t…","key_points":[],"chapters":[],"topics":[],"duration_seconds":4772,"processing_state":"not_requested","actions":[{"name":"request_transcript","method":"POST","url":"https://stenobird.com/v1/public/podcasts/the-growth-podcast-6993153/episodes/how-to-run-evals-in-claude-code-with-aparna-dhinakaran-founder-and-cpo-of-arize/transcription-requests","description":"Idempotently request low-priority transcript generation for this episode."},{"name":"read_markdown","method":"GET","url":"https://stenobird.com/podcast/the-growth-podcast-6993153/how-to-run-evals-in-claude-code-with-aparna-dhinakaran-founder-and-cpo-of-arize.md","description":"Read the agent-friendly Markdown representation of this episode resource."}]}}