Episode

Networks for AB Testing

Podcast
Data Skeptic
Published
Nov 25, 2024
Duration seconds
2202
Processing state
failed
Canonical source
https://dataskeptic.com/blog/episodes/2024/networks-for-ab-testing
Audio
https://pscrb.fm/rss/p/mgln.ai/e/35/traffic.libsyn.com/secure/dataskeptic/558-networks-for-ab-testing.mp3?dest-id=201630
JSON
/v1/public/podcasts/data-skeptic/episodes/networks-for-ab-testing
Markdown
/podcast/data-skeptic/networks-for-ab-testing.md

Actions

  • POST https://stenobird.com/v1/public/podcasts/data-skeptic/episodes/networks-for-ab-testing/transcription-requests
    Idempotently request low-priority transcript generation for this episode.
  • GET https://stenobird.com/podcast/data-skeptic/networks-for-ab-testing.md
    Read the agent-friendly Markdown representation of this episode resource.

Summary

In this episode, the data scientist Wentao Su shares his experience in AB testing on social media platforms like LinkedIn and TikTok. We talk about how network science can enhance AB testing by accounting for complex social interactions, especially in environments where users are both viewers and content creators. These interactions might cause a "spillover effect" meaning a possible influence across experimental groups, which can distort results. To mitigate this effect, our guest presents heuristics and algorithms they developed ("one-degree label propagation") to allow for good results on big data with minimal running time and so optimize user experience and advertiser performance in social media platforms.