{"podcast":{"title":"Gradient Dissent: Conversations on AI","slug":"gradient-dissent","podcast_index_feed_id":1020509,"rss_url":"https://feeds.captivate.fm/gradient-dissent/","website_url":"https://wandb.ai/site/resources/podcast","image_url":"https://artwork.captivate.fm/25fd1181-b46e-459b-85a5-d397eec4cdcf/JDLDW81K-wlJoAWL7ZnxLdTp.jpg","author":"Lukas Biewald","episode_count":136,"summary":"Join Lukas Biewald on Gradient Dissent, an AI-focused podcast brought to you by Weights & Biases. Dive into fascinating conversations with industry giants from NVIDIA, Meta, Google, Lyft, OpenAI, and more. Explore the cutting-edge of AI and learn the intricacies of bringing models into production.","last_synced_at":null,"page_url":"https://stenobird.com/podcast/gradient-dissent"},"episode":{"title":"Peter & Boris — Fine-tuning OpenAI's GPT-3","slug":"peter-boris-fine-tuning-openai-s-gpt-3","published_at":"2022-02-10T15:20:00+00:00","page_url":"https://stenobird.com/podcast/gradient-dissent/peter-boris-fine-tuning-openai-s-gpt-3","show_page_url":"https://stenobird.com/podcast/gradient-dissent","url":"https://wandb.ai/site/resources/podcast","audio_url":"https://podcasts.captivate.fm/media/35ebd136-23ea-45b2-b667-7c6004d4d481/gd-peterw-boris-v3.mp3","summary":"Peter Welinder is VP of Product & Partnerships at OpenAI, where he runs product and commercialization efforts of GPT-3, Codex, GitHub Copilot, and more. Boris Dayma is Machine Learning Engineer at Weights & Biases, and works on integrations and large model training. Peter, Boris, and Lukas dive into the world of GPT-3: - How people are applying GPT-3 to translation, copywriting, and other commercial tasks - The performance benefits of fine-tuning GPT-3- - Developing an API on top of GPT-3 that works out of the box, but is also flexible and customizable They also discuss the new OpenAI and Weights & Biases collaboration, which enables a user to log their GPT-3 fine-tuning projects to W&B with a single line of code. The complete show notes (transcript and links) can be found here: http://wandb.me/gd-peter-and-boris --- Connect with Peter & Boris: 📍 Peter's Twitter: https://twitter.com/npew 📍 Boris' Twitter: https://twitter.com/borisdayma --- ⏳ Timestamps: 0:00 Intro 1:01 Solving real-world problems with GPT-3 6:57 Applying GPT-3 to translation tasks 14:58 Copywriting and other commercial GPT-3 applications 20:22 The OpenAI API and fine-tuning GPT-3 28:22 Logging GPT-3 fine-tuning projects to W&B 38:25 Engineering challenges behind OpenAI's API 43:15 Outro --- Subscribe and listen to our podcast today! 👉 Apple Podcasts: http://wandb.me/apple-podcasts​​ 👉 Google Podcasts: http://wandb.me/google-podcasts​ 👉 Spotify: http://wandb.me/spotify​","meta_description":"Peter Welinder is VP of Product & Partnerships at OpenAI, where he runs product and commercialization efforts of GPT-3, Codex, GitHub Copilot, and mor…","key_points":[],"chapters":[],"topics":[],"duration_seconds":2619,"processing_state":"failed","actions":[{"name":"request_transcript","method":"POST","url":"https://stenobird.com/v1/public/podcasts/gradient-dissent/episodes/peter-boris-fine-tuning-openai-s-gpt-3/transcription-requests","description":"Idempotently request low-priority transcript generation for this episode."},{"name":"read_markdown","method":"GET","url":"https://stenobird.com/podcast/gradient-dissent/peter-boris-fine-tuning-openai-s-gpt-3.md","description":"Read the agent-friendly Markdown representation of this episode resource."}]}}