{"podcast":{"title":"muckrAIkers","slug":"muckraikers-7026051","podcast_index_feed_id":7026051,"rss_url":"https://feeds.transistor.fm/muckraikers","website_url":"https://kairos.fm/muckraikers/","image_url":"https://img.transistorcdn.com/2Xoj9Q8V0g3EZ4QkfrR-DMBxWLBu5eO1bikePOFS7Ng/rs:fill:0:0:1/w:1400/h:1400/q:60/mb:500000/aHR0cHM6Ly9pbWct/dXBsb2FkLXByb2R1/Y3Rpb24udHJhbnNp/c3Rvci5mbS83MzQ3/NzVkMTk3MWFiM2Nl/ZDRmNzFhMGQxZDQ3/MzM3Yi5wbmc.jpg","author":"Jacob Haimes","episode_count":25,"summary":"Join us as we dig a tiny bit deeper into the hype surrounding \"AI\" press releases, research papers, and more. Each episode, we'll highlight ongoing research and investigations, providing some much needed contextualization, constructive critique, and even a smidge of occasional good will teasing to the conversation, trying to find the meaning under all of this muck.","last_synced_at":"2026-07-15T04:21:26.211565+00:00","page_url":"https://stenobird.com/podcast/muckraikers-7026051"},"episode":{"title":"AI, Reasoning or Rambling?","slug":"ai-reasoning-or-rambling","published_at":"2025-07-14T15:00:00+00:00","page_url":"https://stenobird.com/podcast/muckraikers-7026051/ai-reasoning-or-rambling","show_page_url":"https://stenobird.com/podcast/muckraikers-7026051","url":"https://kairos.fm/muckraikers/e015","audio_url":"https://op3.dev/e/media.transistor.fm/3ac97807/0cedd748.mp3","summary":"In this episode, we redefine AI's \"reasoning\" as mere rambling , exposing the \"illusion of thinking\" and \"Potemkin understanding\" in current models. We contrast the classical definition of reasoning (requiring logic and consistency) with Big Tech's new version, which is a generic statement about information processing. We explain how Large Rambling Models generate extensive, often irrelevant, rambling traces that appear to improve benchmarks, largely due to best-of-N sampling and benchmark gaming. Words and definitions actually matter! Carelessness leads to misplaced investments and an overestimation of systems that are currently just surprisingly useful autocorrects. (00:00) - Intro (00:40) - OBB update and Meta's talent acquisition (03:09) - What are rambling models? (04:25) - Definitions and polarization (09:50) - Logic and consistency (17:00) - Why does this matter? (21:40) - More likely explanations (35:05) - The \"illusion of thinking\" and task complexity (39:07) - \"Potemkin understanding\" and surface-level recall (50:00) - Benchmark gaming and best-of-n sampling (55:40) - Costs and limitations (58:24) - Claude's anecdote and the Vending Bench (01:03:05) - Definitional switch and implications (01:10:18) - Outro Links Apple paper - The Illusion of Thinking ICML 2025 paper - Potemkin Understanding in Large Language Models Preprint - Large Language Monkeys: Scaling Inference Compute with Repeated Sampling Theoretical understanding Max M. Schlereth Manuscript - The limits of AGI part II Preprint - (How) Do Reasoning Models Reason? Preprint - A Little Depth Goes a Long Way: The Expressive Power of Log-Depth Transformers NeurIPS 2024 paper - How Far Can Transformers Reason? The Globality Barrier and Inductive Scratchpad Empirical explanations Preprint - How Do Large Lan…","meta_description":"In this episode, we redefine AI's \"reasoning\" as mere rambling , exposing the \"illusion of thinking\" and \"Potemkin understanding\" in current models. We co…","key_points":[],"chapters":[],"topics":[],"duration_seconds":4268,"processing_state":"not_requested","actions":[{"name":"request_transcript","method":"POST","url":"https://stenobird.com/v1/public/podcasts/muckraikers-7026051/episodes/ai-reasoning-or-rambling/transcription-requests","description":"Idempotently request low-priority transcript generation for this episode."},{"name":"read_markdown","method":"GET","url":"https://stenobird.com/podcast/muckraikers-7026051/ai-reasoning-or-rambling.md","description":"Read the agent-friendly Markdown representation of this episode resource."}]}}