Episode
Providing Greater Access to LLMs with Brandon Duderstadt, Co-Founder and CEO of Nomic AI
- Published
- Jul 27, 2023
- Duration seconds
- 3685
- Processing state
failed- Canonical source
- https://wandb.ai/site/resources/podcast
Actions
POST https://stenobird.com/v1/public/podcasts/gradient-dissent/episodes/providing-greater-access-to-llms-with-brandon-duderstadt-co-founder-and-ceo-of-nomic-ai/transcription-requests
Idempotently request low-priority transcript generation for this episode.GET https://stenobird.com/podcast/gradient-dissent/providing-greater-access-to-llms-with-brandon-duderstadt-co-founder-and-ceo-of-nomic-ai.md
Read the agent-friendly Markdown representation of this episode resource.
Summary
On this episode, we’re joined by Brandon Duderstadt, Co-Founder and CEO of Nomic AI . Both of Nomic AI’s products, Atlas and GPT4All, aim to improve the explainability and accessibility of AI. We discuss: - (0:55) What GPT4All is and its value proposition. - (6:56) The advantages of using smaller LLMs for specific tasks. - (9:42) Brandon’s thoughts on the cost of training LLMs. - (10:50) Details about the current state of fine-tuning LLMs. - (12:20) What quantization is and what it does. - (21:16) What Atlas is and what it allows you to do. - (27:30) Training code models versus language models. - (32:19) Details around evaluating different models. - (38:34) The opportunity for smaller companies to build open-source models. - (42:00) Prompt chaining versus fine-tuning models. Resources mentioned: Brandon Duderstadt - https://www.linkedin.com/in/brandon-duderstadt-a3269112a/ Nomic AI - https://www.linkedin.com/company/nomic-ai/ Nomic AI Website - https://home.nomic.ai/ Thanks for listening to the Gradient Dissent podcast, brought to you by Weights & Biases. If you enjoyed this episode, please leave a review to help get the word out about the show. And be sure to subscribe so you never miss another insightful conversation. #OCR #DeepLearning #AI #Modeling #ML