Episode
Understanding AI World Models w/ Chris Canal
- Podcast
- muckrAIkers
- Published
- Jan 27, 2025
- Duration seconds
- 11985
- Processing state
not_requested- Canonical source
- https://kairos.fm/muckraikers/e011/
Actions
POST https://stenobird.com/v1/public/podcasts/muckraikers-7026051/episodes/understanding-ai-world-models-w-chris-canal/transcription-requests
Idempotently request low-priority transcript generation for this episode.GET https://stenobird.com/podcast/muckraikers-7026051/understanding-ai-world-models-w-chris-canal.md
Read the agent-friendly Markdown representation of this episode resource.
Summary
Chris Canal, co-founder of EquiStamp, joins muckrAIkers as our first ever podcast guest! In this ~3.5 hour interview, we discuss intelligence vs. competencies, the importance of test-time compute, moving goalposts, the orthogonality thesis, and much more. A seasoned software developer, Chris started EquiStamp as a way to improve our current understanding of model failure modes and capabilities in late 2023. Now a key contractor for METR, EquiStamp evaluates the next generation of LLMs from frontier model developers like OpenAI and Anthropic. EquiStamp is hiring, so if you're a software developer interested in a fully remote opportunity with flexible working hours, join the EquiStamp Discord server and message Chris directly; oh, and let him know muckrAIkers sent you! (00:00) - Recording date (00:05) - Intro (00:29) - Hot off the press (02:17) - Introducing Chris Canal (19:12) - World/risk models (35:21) - Competencies + decision making power (42:09) - Breaking models down (01:05:06) - Timelines, test time compute (01:19:17) - Moving goalposts (01:26:34) - Risk management pre-AGI (01:46:32) - Happy endings (01:55:50) - Causal chains (02:04:49) - Appetite for democracy (02:20:06) - Tech-frame based fallacies (02:39:56) - Bringing back real capitalism (02:45:23) - Orthogonality Thesis (03:04:31) - Why we do this (03:15:36) - Equistamp! Links EquiStamp Chris's Twitter METR Paper - RE-Bench: Evaluating frontier AI R&D capabilities of language model agents against human experts All Trades article - Learning from History: Preventing AGI Existential Risks through Policy by Chris Canal Better Systems article - The Omega Protocol: Another Manhattan Project Superintelligence & Commentary Wikipedia article - Superintelligence: Paths, Dangers, Strategies by Nick Bostrom Ref…