{"podcast":{"title":"The Robot Brains Podcast","slug":"robot-brains-podcast","podcast_index_feed_id":2136067,"rss_url":"https://feeds.acast.com/public/shows/the-robot-brains","website_url":"https://shows.acast.com/the-robot-brains","image_url":"https://assets.pippa.io/shows/6053a29a0d11b0148adcfc96/1617091773845-808cfbe200b5e99e0a9deac35e5f0dab.jpeg","author":"The Robot Brains Podcast","episode_count":67,"summary":"In each episode of The Robot Brains podcast, renowned artificial intelligence researcher, professor and entrepreneur Pieter Abbeel meets the brilliant minds attempting to build robots with brains. Pieter is joined by leading experts in AI Robotics from all over the world as he explores how far humanity has come in its mission to create conscious computers, mindful machines and rational robots. Host: Pieter Abbeel | Executive Producers: Alice Patel & Henry Tobias Jones | Audio Production: Kieron Matthew Banerji | Title Music: Alejandro Del Pozo Hosted on Acast. See acast.com/privacy for more information.","last_synced_at":null,"page_url":"https://stenobird.com/podcast/robot-brains-podcast"},"episode":{"title":"Jitendra Malik: Building AI from the ground-up, sensorimotor before language","slug":"jitendra-malik-building-ai-from-the-ground-up-sensorimotor-before-language","published_at":"2023-08-17T03:06:43+00:00","page_url":"https://stenobird.com/podcast/robot-brains-podcast/jitendra-malik-building-ai-from-the-ground-up-sensorimotor-before-language","show_page_url":"https://stenobird.com/podcast/robot-brains-podcast","url":"https://www.therobotbrains.ai/who-is-jitendra-malik","audio_url":"https://sphinx.acast.com/p/open/s/6053a29a0d11b0148adcfc96/e/64dd8ec4e0516a001156b260/media.mp3","summary":"Jitendra Malik argues that true intelligence requires building from sensorimotor foundations rather than relying solely on large language models. He explores how vision and physical interaction are essential precursors to higher-level reasoning.","meta_description":"UC Berkeley Professor Jitendra Malik discusses the necessity of sensorimotor learning, the evolution of computer vision, and why AI needs grounding.","key_points":["Main idea: Intelligence is best developed by prioritizing physical, sensorimotor capabilities before language-based reasoning","Practical takeaway: Using vision to augment quadrupedal locomotion allows robots to navigate complex terrains like stairs that are difficult for 'blind' agents","Failure mode: Relying exclusively on large language models without grounding them in physical reality may result in fundamentally limited AI","Main idea: The transition of computer vision from an algorithmic field to a benchmark-driven science was critical for its acceleration","Perspective: Historical parallels in science suggest that current AI uncertainty is a natural phase of an embryonic discipline"],"chapters":[{"start_ms":65000,"title":"The Evolution of Computer Vision","summary":"A look at how Jitendra Malik helped transform computer vision into a benchmark-driven, scientific discipline."},{"start_ms":420000,"title":"The Sensorimotor Thesis","summary":"Discussing whether intelligence arises from the ability to manipulate objects or the ability to see."},{"start_ms":745000,"title":"Language Models vs. Grounding","summary":"Evaluating the risks of building AI using large language models first and attempting to add physical grounding later."},{"start_ms":1105000,"title":"The Importance of Iterative Learning","summary":"Why agents need sufficient environmental rollouts to acquire foundational skills before higher-level tasks can be learned."},{"start_ms":1450000,"title":"Adaptive Control and Learning","summary":"Connecting modern machine learning paradigms to classical adaptive control theories."},{"start_ms":1820000,"title":"Neural Network Versatility","summary":"How a single neural network policy can adapt to diverse and changing robotic scenarios."},{"start_ms":2165000,"title":"The Simulation-to-Real Gap","summary":"Addressing the limitations of simulators and the difficulty of capturing real-world diversity in training."},{"start_ms":2510000,"title":"The Challenges of Bipedalism","summary":"Comparing the relative ease of quadrupedal locomotion to the unsolved complexities of stable bipedal walking."}],"topics":["Computer Vision","Robotics","Artificial Intelligence","Sensorimotor Learning","Machine Learning","Large Language Models","Neural Networks","Adaptive Control"],"duration_seconds":4550,"processing_state":"processed","actions":[{"name":"request_transcript","method":"POST","url":"https://stenobird.com/v1/public/podcasts/robot-brains-podcast/episodes/jitendra-malik-building-ai-from-the-ground-up-sensorimotor-before-language/transcription-requests","description":"Idempotently request low-priority transcript generation for this episode."},{"name":"read_markdown","method":"GET","url":"https://stenobird.com/podcast/robot-brains-podcast/jitendra-malik-building-ai-from-the-ground-up-sensorimotor-before-language.md","description":"Read the agent-friendly Markdown representation of this episode resource."}]}}