{"podcast":{"title":"Gradient Dissent: Conversations on AI","slug":"gradient-dissent","podcast_index_feed_id":1020509,"rss_url":"https://feeds.captivate.fm/gradient-dissent/","website_url":"https://wandb.ai/site/resources/podcast","image_url":"https://artwork.captivate.fm/25fd1181-b46e-459b-85a5-d397eec4cdcf/JDLDW81K-wlJoAWL7ZnxLdTp.jpg","author":"Lukas Biewald","episode_count":136,"summary":"Join Lukas Biewald on Gradient Dissent, an AI-focused podcast brought to you by Weights & Biases. Dive into fascinating conversations with industry giants from NVIDIA, Meta, Google, Lyft, OpenAI, and more. Explore the cutting-edge of AI and learn the intricacies of bringing models into production.","last_synced_at":null,"page_url":"https://stenobird.com/podcast/gradient-dissent"},"episode":{"title":"Scaling LLMs and Accelerating Adoption with Aidan Gomez at Cohere","slug":"scaling-llms-and-accelerating-adoption-with-aidan-gomez-at-cohere","published_at":"2023-04-20T04:05:00+00:00","page_url":"https://stenobird.com/podcast/gradient-dissent/scaling-llms-and-accelerating-adoption-with-aidan-gomez-at-cohere","show_page_url":"https://stenobird.com/podcast/gradient-dissent","url":"https://wandb.ai/site/resources/podcast","audio_url":"https://podcasts.captivate.fm/media/d05cc323-31a7-4792-ba1e-894ad88b9438/WEIGHTS-Aidan-Gomez-V3.mp3","summary":"On this episode, we’re joined by Aidan Gomez , Co-Founder and CEO at Cohere . Cohere develops and releases a range of innovative AI-powered tools and solutions for a variety of NLP use cases. We discuss: - What “attention” means in the context of ML. - Aidan’s role in the “Attention Is All You Need” paper. - What state-space models (SSMs) are, and how they could be an alternative to transformers. - What it means for an ML architecture to saturate compute. - Details around data constraints for when LLMs scale. - Challenges of measuring LLM performance. - How Cohere is positioned within the LLM development space. - Insights around scaling down an LLM into a more domain-specific one. - Concerns around synthetic content and AI changing public discourse. - The importance of raising money at healthy milestones for AI development. Aidan Gomez - https://www.linkedin.com/in/aidangomez/ Cohere - https://www.linkedin.com/company/cohere-ai/ Thanks for listening to the Gradient Dissent podcast, brought to you by Weights & Biases. If you enjoyed this episode, please leave a review to help get the word out about the show. And be sure to subscribe so you never miss another insightful conversation. Resources: - https://cohere.ai/ - “Attention Is All You Need” #OCR #DeepLearning #AI #Modeling #ML","meta_description":"On this episode, we’re joined by Aidan Gomez , Co-Founder and CEO at Cohere . Cohere develops and releases a range of innovative AI-powered tools and solu…","key_points":[],"chapters":[],"topics":[],"duration_seconds":3091,"processing_state":"failed","actions":[{"name":"request_transcript","method":"POST","url":"https://stenobird.com/v1/public/podcasts/gradient-dissent/episodes/scaling-llms-and-accelerating-adoption-with-aidan-gomez-at-cohere/transcription-requests","description":"Idempotently request low-priority transcript generation for this episode."},{"name":"read_markdown","method":"GET","url":"https://stenobird.com/podcast/gradient-dissent/scaling-llms-and-accelerating-adoption-with-aidan-gomez-at-cohere.md","description":"Read the agent-friendly Markdown representation of this episode resource."}]}}