{"podcast":{"title":"Gradient Dissent: Conversations on AI","slug":"gradient-dissent","podcast_index_feed_id":1020509,"rss_url":"https://feeds.captivate.fm/gradient-dissent/","website_url":"https://wandb.ai/site/resources/podcast","image_url":"https://artwork.captivate.fm/25fd1181-b46e-459b-85a5-d397eec4cdcf/JDLDW81K-wlJoAWL7ZnxLdTp.jpg","author":"Lukas Biewald","episode_count":136,"summary":"Join Lukas Biewald on Gradient Dissent, an AI-focused podcast brought to you by Weights & Biases. Dive into fascinating conversations with industry giants from NVIDIA, Meta, Google, Lyft, OpenAI, and more. Explore the cutting-edge of AI and learn the intricacies of bringing models into production.","last_synced_at":null,"page_url":"https://stenobird.com/podcast/gradient-dissent"},"episode":{"title":"What’s the path to AGI? A conversation with Turing Co-founder and CEO Jonathan Siddharth","slug":"what-s-the-path-to-agi-a-conversation-with-turing-co-founder-and-ceo-jonathan-siddharth","published_at":"2024-11-07T10:00:00+00:00","page_url":"https://stenobird.com/podcast/gradient-dissent/what-s-the-path-to-agi-a-conversation-with-turing-co-founder-and-ceo-jonathan-siddharth","show_page_url":"https://stenobird.com/podcast/gradient-dissent","url":"https://wandb.ai/site/resources/podcast","audio_url":"https://podcasts.captivate.fm/media/e2b8442f-d5bb-4169-a8c9-d96aacf9c38f/GD023-Pod.mp3","summary":"The bottleneck for AGI has shifted from compute and raw internet data to the need for high-quality human intelligence. Turing CEO Jonathan Siddharth explains how scaling human-annotated reasoning and coding data is the next frontier for frontier model training.","meta_description":"Explore the path to AGI through the lens of human intelligence scaling, coding tokens, and the evolution of high-quality training data with Turing's CEO.","key_points":["Main idea: The primary bottleneck for AGI progress is no longer compute, but the availability of high-quality, intelligent tokens","Main idea: Coding data acts as a catalyst for broader capabilities, improving symbolic reasoning, logic, and mathematics","Practical takeaway: Scaling human intelligence requires a global, vetted 'developer cloud' to provide specialized domain expertise at scale","Failure mode: Relying solely on synthetic data or self-play without a robust reward function or simulator may limit model generalization","Practical takeaway: Enterprise AI adoption will likely remain 'human-in-the-loop' for the foreseeable future, focusing on audit and compliance"],"chapters":[{"start_ms":60000,"title":"The Shift from Compute to Intelligence","summary":"Discussion on why the AGI bottleneck has moved from hardware and raw web data to the need for high-quality human reasoning."},{"start_ms":310000,"title":"Scaling Human Expertise","summary":"How to find, vet, and match the world's smartest engineers and scientists to power model training."},{"start_ms":550000,"title":"Optimizing for Price-Performance","summary":"Leveraging global labor markets to scale the demand for high-quality training datasets."},{"start_ms":1050000,"title":"Beyond Code: Reasoning and Post-Training","summary":"The importance of using coding tokens to improve symbolic reasoning, logic, and arithmetic in LLMs."},{"start_ms":1295000,"title":"Expanding into New Knowledge Domains","summary":"Moving beyond software engineering into marketing, finance, and healthcare to distill human knowledge."},{"start_ms":2055000,"title":"The Limits of Synthetic Data","summary":"The challenges of using models to bootstrap themselves without effective simulators or reward functions."},{"start_ms":2550000,"title":"The Future of Enterprise AI","summary":"Why the next wave of enterprise AI will focus on human-in-the-loop systems and compliance-driven copilots."}],"topics":["AGI","Large Language Models","Human-in-the-loop","Synthetic Data","Software Engineering","Machine Learning Training","Reasoning Capabilities","Enterprise AI"],"duration_seconds":3288,"processing_state":"processed","actions":[{"name":"request_transcript","method":"POST","url":"https://stenobird.com/v1/public/podcasts/gradient-dissent/episodes/what-s-the-path-to-agi-a-conversation-with-turing-co-founder-and-ceo-jonathan-siddharth/transcription-requests","description":"Idempotently request low-priority transcript generation for this episode."},{"name":"read_markdown","method":"GET","url":"https://stenobird.com/podcast/gradient-dissent/what-s-the-path-to-agi-a-conversation-with-turing-co-founder-and-ceo-jonathan-siddharth.md","description":"Read the agent-friendly Markdown representation of this episode resource."}]}}