Episode
What is Model Distillation?
- Podcast
- Generative AI 101
- Published
- Aug 4, 2026
- Duration seconds
- 880
- Processing state
not_requested
Actions
POST https://stenobird.com/v1/public/podcasts/generative-ai-101-6932184/episodes/what-is-model-distillation/transcription-requests
Idempotently request low-priority transcript generation for this episode.GET https://stenobird.com/podcast/generative-ai-101-6932184/what-is-model-distillation.md
Read the agent-friendly Markdown representation of this episode resource.
Summary
Elon Musk said under oath that xAI partly distills OpenAI's models, and the courtroom gasped. Host Emily Laird takes apart what model distillation actually is, why hiding chain of thought was never a real defense (fabricated reasoning traces deliver roughly 96.7 percent of the value of genuine internal access), and what 24,000 fraudulent accounts look like when no vulnerability was exploited and the product worked exactly as designed. The uncomfortable part is structural: every dollar spent making a model cleaner and safer makes it a better teacher for whoever is copying it. Capability transfers through distillation, safety does not, and nobody has ever un-released 2.8 trillion parameters. 🎯 JOIN THE AI WEEKLY MEETUPS https://www.uwstout.edu/ai-weekly-meetup 📩 EMAIL REMINDERS FOR THE MEETUPS https://app.e2ma.net/app2/audience/signup/2101263/1779703/ 💬 CONNECT WITH EMILY LAIRD ON LINKEDIN http://www.linkedin.com/in/meet-emily-laird