Episode

How Shopify Built A Machine Learning Platform That Encourages Experimentation

Podcast
AI Engineering Podcast
Published
Feb 2, 2023
Duration seconds
3972
Processing state
failed
Canonical source
https://www.aiengineeringpodcast.com/shopify-merlin-ml-platform-episode-16
Audio
https://op3.dev/e/dts.podtrac.com/redirect.mp3/serve.podhome.fm/episode/f6ff0caa-931b-4c08-bfdd-08dc7f5cd336/63853053821746750948fd798e-d0ad-492f-b109-1383ef9e81a8.mp3
JSON
/v1/public/podcasts/ai-engineering-podcast/episodes/how-shopify-built-a-machine-learning-platform-that-encourages-experimentation
Markdown
/podcast/ai-engineering-podcast/how-shopify-built-a-machine-learning-platform-that-encourages-experimentation.md

Actions

  • POST https://stenobird.com/v1/public/podcasts/ai-engineering-podcast/episodes/how-shopify-built-a-machine-learning-platform-that-encourages-experimentation/transcription-requests
    Idempotently request low-priority transcript generation for this episode.
  • GET https://stenobird.com/podcast/ai-engineering-podcast/how-shopify-built-a-machine-learning-platform-that-encourages-experimentation.md
    Read the agent-friendly Markdown representation of this episode resource.

Summary

Summary Shopify uses machine learning to power multiple features in their platform. In order to reduce the amount of effort required to develop and deploy models they have invested in building an opinionated platform for their engineers. They have gone through multiple iterations of the platform and their most recent version is called Merlin. In this episode Isaac Vidas shares the use cases that they are optimizing for, how it integrates into the rest of their data platform, and how they have designed it to let machine learning engineers experiment freely and safely. Announcements Hello and welcome to the Machine Learning Podcast, the podcast about machine learning and how to bring it from idea to delivery. Your host is Tobias Macey and today I'm interviewing Isaac Vidas about his work on the ML platform used by Shopify Interview Introduction How did you get involved in machine learning? Can you describe what Shopify is and some of the ways that you are using ML at Shopify?  What are the challenges that you have encountered as an organization in applying ML to your business needs? Can you describe how you have designed your current technical platform for supporting ML workloads?  Who are the target personas for this platform? What does the workflow look like for a given data scientist/ML engineer/etc.? What are the capabilities that you are trying to optimize for in your current platform?  What are some of the previous iterations of ML infrastructure and process that you have built? What are the most useful lessons that you gathered from those previous experiences that informed your current approach? How have the capabilities of the Merlin platform influenced the ways that ML is viewed and applied across Shopify? What are the most interesting, innovative…