Episode
Clément Delangue — The Power of the Open Source Community
- Published
- Jun 10, 2021
- Duration seconds
- 2795
- Processing state
failed- Canonical source
- https://wandb.ai/site/resources/podcast
Actions
POST https://stenobird.com/v1/public/podcasts/gradient-dissent/episodes/cl-ment-delangue-the-power-of-the-open-source-community/transcription-requests
Idempotently request low-priority transcript generation for this episode.GET https://stenobird.com/podcast/gradient-dissent/cl-ment-delangue-the-power-of-the-open-source-community.md
Read the agent-friendly Markdown representation of this episode resource.
Summary
Clem explains the virtuous cycles behind the creation and success of Hugging Face, and shares his thoughts on where NLP is heading. --- Clément Delangue is co-founder and CEO of Hugging Face, the AI community building the future. Hugging Face started as an open source NLP library and has quickly grown into a commercial product used by over 5,000 companies. Connect with Clem: 📍 Twitter: https://twitter.com/ClementDelangue 📍 LinkedIn: https://www.linkedin.com/in/clementdelangue/ --- 🌟 Transcript: http://wandb.me/gd-clement-delangue 🌟 ⏳ Timestamps: 0:00 Sneak peek and intro 0:56 What is Hugging Face? 4:15 The success of Hugging Face Transformers 7:53 Open source and virtuous cycles 10:37 Working with both TensorFlow and PyTorch 13:20 The "Write With Transformer" project 14:36 Transfer learning in NLP 16:43 BERT and DistilBERT 22:33 GPT 26:32 The power of the open source community 29:40 Current applications of NLP 35:15 The Turing Test and conversational AI 41:19 Why speech is an upcoming field within NLP 43:44 The human challenges of machine learning Links Discussed: 📍 Write With Transformer, Hugging Face Transformer's text generation demo: https://transformer.huggingface.co/ 📍 "Attention Is All You Need" (Vaswani et al., 2017): https://arxiv.org/abs/1706.03762 📍 EleutherAI and GPT-Neo: https://github.com/EleutherAI/gpt-neo] 📍 Rasa, open source conversational AI: https://rasa.com/ 📍 Roblox article on BERT: https://blog.roblox.com/2020/05/scaled-bert-serve-1-billion-daily-requests-cpus/ --- Get our podcast on these platforms: 👉 Apple Podcasts: http://wandb.me/apple-podcasts 👉 Spotify: http://wandb.me/spotify 👉 Google Podcasts: http://wandb.me/google-podcasts 👉 YouTube: http://wandb.me/youtube 👉 Soundcloud: http://wandb.me/soundcloud Join our community of ML practit…