{"podcast":{"title":"Gradient Dissent: Conversations on AI","slug":"gradient-dissent","podcast_index_feed_id":1020509,"rss_url":"https://feeds.captivate.fm/gradient-dissent/","website_url":"https://wandb.ai/site/resources/podcast","image_url":"https://artwork.captivate.fm/25fd1181-b46e-459b-85a5-d397eec4cdcf/JDLDW81K-wlJoAWL7ZnxLdTp.jpg","author":"Lukas Biewald","episode_count":136,"summary":"Join Lukas Biewald on Gradient Dissent, an AI-focused podcast brought to you by Weights & Biases. Dive into fascinating conversations with industry giants from NVIDIA, Meta, Google, Lyft, OpenAI, and more. Explore the cutting-edge of AI and learn the intricacies of bringing models into production.","last_synced_at":null,"page_url":"https://stenobird.com/podcast/gradient-dissent"},"episode":{"title":"How EleutherAI Trains and Releases LLMs: Interview with Stella Biderman","slug":"how-eleutherai-trains-and-releases-llms-interview-with-stella-biderman","published_at":"2023-05-04T04:00:00+00:00","page_url":"https://stenobird.com/podcast/gradient-dissent/how-eleutherai-trains-and-releases-llms-interview-with-stella-biderman","show_page_url":"https://stenobird.com/podcast/gradient-dissent","url":"https://wandb.ai/site/resources/podcast","audio_url":"https://podcasts.captivate.fm/media/7e8f1e30-7ee2-4c22-9681-d213ac27087f/WEIGHTS-Stella-Biderman-V3.mp3","summary":"On this episode, we’re joined by Stella Biderman , Executive Director at EleutherAI and Lead Scientist - Mathematician at Booz Allen Hamilton. EleutherAI is a grassroots collective that enables open-source AI research and focuses on the development and interpretability of large language models (LLMs). We discuss: - How EleutherAI got its start and where it's headed. - The similarities and differences between various LLMs. - How to decide which model to use for your desired outcome. - The benefits and challenges of reinforcement learning from human feedback. - Details around pre-training and fine-tuning LLMs. - Which types of GPUs are best when training LLMs. - What separates EleutherAI from other companies training LLMs. - Details around mechanistic interpretability. - Why understanding what and how LLMs memorize is important. - The importance of giving researchers and the public access to LLMs. Stella Biderman - https://www.linkedin.com/in/stellabiderman/ EleutherAI - https://www.linkedin.com/company/eleutherai/ Resources: - https://www.eleuther.ai/ Thanks for listening to the Gradient Dissent podcast, brought to you by Weights & Biases. If you enjoyed this episode, please leave a review to help get the word out about the show. And be sure to subscribe so you never miss another insightful conversation. #OCR #DeepLearning #AI #Modeling #ML","meta_description":"On this episode, we’re joined by Stella Biderman , Executive Director at EleutherAI and Lead Scientist - Mathematician at Booz Allen Hamilton. EleutherAI…","key_points":[],"chapters":[],"topics":[],"duration_seconds":3436,"processing_state":"failed","actions":[{"name":"request_transcript","method":"POST","url":"https://stenobird.com/v1/public/podcasts/gradient-dissent/episodes/how-eleutherai-trains-and-releases-llms-interview-with-stella-biderman/transcription-requests","description":"Idempotently request low-priority transcript generation for this episode."},{"name":"read_markdown","method":"GET","url":"https://stenobird.com/podcast/gradient-dissent/how-eleutherai-trains-and-releases-llms-interview-with-stella-biderman.md","description":"Read the agent-friendly Markdown representation of this episode resource."}]}}