# Exploring Velocity vs. Quality in Experimentation ft. Emma Travis Page: https://stenobird.com/podcast/from-a-to-b-6398785/exploring-velocity-vs-quality-in-experimentation-ft-emma-travis Text version: https://stenobird.com/podcast/from-a-to-b-6398785/exploring-velocity-vs-quality-in-experimentation-ft-emma-travis.md Podcast: [From A to B](https://stenobird.com/podcast/from-a-to-b-6398785) Published: 2025-08-13T01:00:00+00:00 Episode link: https://podcasters.spotify.com/pod/show/from-a-to-b/episodes/Exploring-Velocity-vs--Quality-in-Experimentation-ft--Emma-Travis-e36marb Audio file: https://anchor.fm/s/e25e3fac/podcast/play/106686763/https%3A%2F%2Fd3ctxlq1ktw2nl.cloudfront.net%2Fstaging%2F2025-7-10%2F88799ceb-a92c-de2b-b00a-85b191493b05.mp3 Processing state: not_requested JSON: https://stenobird.com/v1/public/podcasts/from-a-to-b-6398785/episodes/exploring-velocity-vs-quality-in-experimentation-ft-emma-travis Duration seconds: 3148 ## Resource We back out here with the amazing Emma Travis to dig into 'quality vs. quantity' when it comes to experimentation programs. The conversation Ben Labay keeps trying to force, but a bit more nuance to it. There is a time and place for quality. But there is a time and place for velocity and scaling your program up in terms of number of tests run. How do you know when to do it? And what are triggers to get you .... ahem.... From A to B. Emma "Biscuits and Gravy" Travis joined me on this episode to go DEEP into this topic. Emma was sick and still trooped through this episode - give her all the flowers!!! We got into: - When to focus on velocity vs. when to focus on ‘quality’ of experiment - Tips on auditing your program to know if you’re too focused on quality vs. quantity - Smart ways to focus on research when resources are limited Timestamps: 00:00 Episode Start 3:57 Is Velocity Appropriate In Tracking Metric For Experimentation Maturity? 9:23 Velocity Increase Doesn't Always Mean A Decline In Quality 11:51 Experimentation Velocity Is Like Flying A Plane 19:19 When To Scale Velocity Vs. When To Focus On Quality 24:33 Run A Heuristic Audit Of Your Cro Program (*Bonus Points For Doing It In Miro) 28:00 What Defines "Quality" In A Test? 36:35 How Do You Communicate A Decline In Velocity Knowing You're Increasing Quality? 40:35 Good Ways To Use Ai To Help You Speed Up Research Go follow Emma Travis on LinkedIn: https://www.linkedin.com/in/emma-travis/ Also go follow Shiva Manjunath on LinkedIn: ⁠https://www.linkedin.com/in/shiva-manjunath/⁠ Subscribe to our newsletter for more memes, clips, and awesome content! https://fromatob.beehiiv.com/ ## Actions - request_transcript: `POST https://stenobird.com/v1/public/podcasts/from-a-to-b-6398785/episodes/exploring-velocity-vs-quality-in-experimentation-ft-emma-travis/transcription-requests` — Idempotently request low-priority transcript generation for this episode. - read_markdown: `GET https://stenobird.com/podcast/from-a-to-b-6398785/exploring-velocity-vs-quality-in-experimentation-ft-emma-travis.md` — Read the agent-friendly Markdown representation of this episode resource. A page view does not enqueue transcription. Agents should invoke `request_transcript` explicitly when they need this episode processed. ## Transcript Full transcripts are not published on public pages unless there is a clear rights basis.