# The Fractured Entangled Representation Hypothesis (Kenneth Stanley, Akarsh Kumar) Page: https://stenobird.com/podcast/machine-learning-street-talk/the-fractured-entangled-representation-hypothesis-kenneth-stanley-akarsh-kumar Text version: https://stenobird.com/podcast/machine-learning-street-talk/the-fractured-entangled-representation-hypothesis-kenneth-stanley-akarsh-kumar.md Podcast: [Machine Learning Street Talk (MLST)](https://stenobird.com/podcast/machine-learning-street-talk) Published: 2025-07-06T00:28:44+00:00 Episode link: https://podcasters.spotify.com/pod/show/machinelearningstreettalk/episodes/The-Fractured-Entangled-Representation-Hypothesis-Kenneth-Stanley--Akarsh-Kumar-e355a6r Audio file: https://anchor.fm/s/1e4a0eac/podcast/play/105080475/https%3A%2F%2Fd3ctxlq1ktw2nl.cloudfront.net%2Fstaging%2F2025-6-6%2F403375610-44100-2-0e8f60325cf2.mp3 Processing state: processed JSON: https://stenobird.com/v1/public/podcasts/machine-learning-street-talk/episodes/the-fractured-entangled-representation-hypothesis-kenneth-stanley-akarsh-kumar Duration seconds: 8182 ## Resource Are the AI models you use today imposters? Please watch the intro video we did before this: https://www.youtube.com/watch?v=o1q6Hhz0MAg In this episode, hosts Dr. Tim Scarfe and Dr. Duggar are joined by AI researcher Prof. Kenneth Stanley and MIT PhD student Akash Kumar to discuss their fascinating paper, "Questioning Representational Optimism in Deep Learning." Imagine you ask two people to draw a perfect skull. One is a brilliant artist who understands anatomy, the other is a machine that just traces the image. Both drawings look identical, but the artist understands what a skull is—they know where the mouth is, how the jaw works, and that it's symmetrical. The machine just has a tangled mess of lines that happens to form the right picture. An AI with an elegant representation, has the building blocks to generate truly new ideas. The Path Is the Goal: As Kenneth Stanley puts it, "it matters not just where you get, but how you got there". Two students can ace a math test, but the one who truly understands the concepts—instead of just memorizing formulas—is the one who will go on to make new discoveries. The show is a mixture of 3 separate recordings we have done, the original Patreon warmup with Tim/Kenneth, the Tim/Keith "Steakhouse" recorded after the main interview, then the main interview with Kenneth/Akarsh/Keith/Tim. Feel free to skip around. We had to edit this in a rush as we are travelling next week but it's reasonably cleaned up. TOC: 00:00:00 Intro: Garbage vs. Amazing Representations 00:05:42 How Good Representations Form 00:11:14 Challenging the "Bitter Lesson" 00:18:04 AI Creativity & Representation Types 00:22:13 Steakhouse: Critiques & Alternatives 00:28:30 Steakhouse: Key Concepts & Goldilocks Zone 0… ## Actions - request_transcript: `POST https://stenobird.com/v1/public/podcasts/machine-learning-street-talk/episodes/the-fractured-entangled-representation-hypothesis-kenneth-stanley-akarsh-kumar/transcription-requests` — Idempotently request low-priority transcript generation for this episode. - read_markdown: `GET https://stenobird.com/podcast/machine-learning-street-talk/the-fractured-entangled-representation-hypothesis-kenneth-stanley-akarsh-kumar.md` — Read the agent-friendly Markdown representation of this episode resource. A page view does not enqueue transcription. Agents should invoke `request_transcript` explicitly when they need this episode processed. ## Transcript Full transcripts are not published on public pages unless there is a clear rights basis.