{"podcast":{"title":"Gradient Dissent: Conversations on AI","slug":"gradient-dissent","podcast_index_feed_id":1020509,"rss_url":"https://feeds.captivate.fm/gradient-dissent/","website_url":"https://wandb.ai/site/resources/podcast","image_url":"https://artwork.captivate.fm/25fd1181-b46e-459b-85a5-d397eec4cdcf/JDLDW81K-wlJoAWL7ZnxLdTp.jpg","author":"Lukas Biewald","episode_count":136,"summary":"Join Lukas Biewald on Gradient Dissent, an AI-focused podcast brought to you by Weights & Biases. Dive into fascinating conversations with industry giants from NVIDIA, Meta, Google, Lyft, OpenAI, and more. Explore the cutting-edge of AI and learn the intricacies of bringing models into production.","last_synced_at":null,"page_url":"https://stenobird.com/podcast/gradient-dissent"},"episode":{"title":"Emily M. Bender — Language Models and Linguistics","slug":"emily-m-bender-language-models-and-linguistics","published_at":"2021-09-09T13:00:00+00:00","page_url":"https://stenobird.com/podcast/gradient-dissent/emily-m-bender-language-models-and-linguistics","show_page_url":"https://stenobird.com/podcast/gradient-dissent","url":"https://wandb.ai/site/resources/podcast","audio_url":"https://podcasts.captivate.fm/media/355d4ea7-90e1-40cd-b10d-7a2d073163ab/gd-emily-bender-v5.mp3","summary":"In this episode, Emily and Lukas dive into the problems with bigger and bigger language models, the difference between form and meaning, the limits of benchmarks, and why it's important to name the languages we study. Show notes (links to papers and transcript): http://wandb.me/gd-emily-m-bender --- Emily M. Bender is a Professor of Linguistics at and Faculty Director of the Master's Program in Computational Linguistics at University of Washington. Her research areas include multilingual grammar engineering, variation (within and across languages), the relationship between linguistics and computational linguistics, and societal issues in NLP. --- Timestamps: 0:00 Sneak peek, intro 1:03 Stochastic Parrots 9:57 The societal impact of big language models 16:49 How language models can be harmful 26:00 The important difference between linguistic form and meaning 34:40 The octopus thought experiment 42:11 Language acquisition and the future of language models 49:47 Why benchmarks are limited 54:38 Ways of complementing benchmarks 1:01:20 The #BenderRule 1:03:50 Language diversity and linguistics 1:12:49 Outro","meta_description":"In this episode, Emily and Lukas dive into the problems with bigger and bigger language models, the difference between form and meaning, the limits of ben…","key_points":[],"chapters":[],"topics":[],"duration_seconds":4375,"processing_state":"failed","actions":[{"name":"request_transcript","method":"POST","url":"https://stenobird.com/v1/public/podcasts/gradient-dissent/episodes/emily-m-bender-language-models-and-linguistics/transcription-requests","description":"Idempotently request low-priority transcript generation for this episode."},{"name":"read_markdown","method":"GET","url":"https://stenobird.com/podcast/gradient-dissent/emily-m-bender-language-models-and-linguistics.md","description":"Read the agent-friendly Markdown representation of this episode resource."}]}}