Episode

Addressing Legitimate Pushback to Experimentation ft. Ton Wesseling

Podcast
From A to B
Published
Mar 12, 2025
Duration seconds
2788
Processing state
not_requested
Canonical source
https://podcasters.spotify.com/pod/show/from-a-to-b/episodes/Addressing-Legitimate-Pushback-to-Experimentation-ft--Ton-Wesseling-e2vttgv
Audio
https://anchor.fm/s/e25e3fac/podcast/play/99595231/https%3A%2F%2Fd3ctxlq1ktw2nl.cloudfront.net%2Fstaging%2F2025-2-9%2F92c62f5d-8f80-ceee-0c9c-654055ec7218.mp3
JSON
/v1/public/podcasts/from-a-to-b-6398785/episodes/addressing-legitimate-pushback-to-experimentation-ft-ton-wesseling
Markdown
/podcast/from-a-to-b-6398785/addressing-legitimate-pushback-to-experimentation-ft-ton-wesseling.md

Actions

  • POST https://stenobird.com/v1/public/podcasts/from-a-to-b-6398785/episodes/addressing-legitimate-pushback-to-experimentation-ft-ton-wesseling/transcription-requests
    Idempotently request low-priority transcript generation for this episode.
  • GET https://stenobird.com/podcast/from-a-to-b-6398785/addressing-legitimate-pushback-to-experimentation-ft-ton-wesseling.md
    Read the agent-friendly Markdown representation of this episode resource.

Summary

Do people have legitimate pushback to A/B testing? I mean, some don't. They just hate being proven wrong. But there are others who DO have legitimate pushback. How do we address this? Ton "The Don" Wesseling offered a ton of helpful thoughts on how we could actually push back on "logical" (but incorrect) reasons why people don't want to A/B test. We got into: - Pushing back on "not all tests win" without sounding like an asshole - Pick your battles wisely, and invest time in those who WANT to test (while don't prioritize those who DON'T want to test... for your own sanity) - Legitimize their concern. Don't talk down to them like they're wrong, because that doesn't help you, nor does it not help them Timestamps: 00:00 Episode Start 04:08 Pushing Back on "The Test May Not Win" 09:50 Navigating Concerns on Testing Redesigns 16:11 Addressing Pushback When It's One vs. Many People (to A/B testing) 25:00 Someone Created Your CRO Role - Go Figure Out How To Be Helpful 32:35 When "Winners" Don't Affect Your Bottom Line Go follow Ton on LinkedIn, and go nominate people who you think deserve Experimentation Culture awards run by Ton and others! (and feel free to nominate us there….) - https://www.linkedin.com/in/tonwesseling/ - https://experimentationcultureawards.com/ Subscribe to our newsletter for more memes, clips, and awesome content! https://fromatob.beehiiv.com/ If you have listener questions, submit them at https://tinyurl.com/askfromatob for a chance to be featured too!