Episode
What if Humans Weaponize Superintelligence, w/ Tom Davidson, from Future of Life Institute Podcast
- Published
- Aug 23, 2025
- Duration seconds
- 7458
- Processing state
processed- Canonical source
- https://www.cognitiverevolution.ai
Actions
POST https://stenobird.com/v1/public/podcasts/the-cognitive-revolution/episodes/what-if-humans-weaponize-superintelligence-w-tom-davidson-from-future-of-life-institute-podcast/transcription-requests
Idempotently request low-priority transcript generation for this episode.GET https://stenobird.com/podcast/the-cognitive-revolution/what-if-humans-weaponize-superintelligence-w-tom-davidson-from-future-of-life-institute-podcast.md
Read the agent-friendly Markdown representation of this episode resource.
Summary
Today Tom Davidson of Forethought joins Gus Docker of the Future of Life Institute podcast to discuss AI-enabled coups and how future AI systems could help powerful individuals seize political control, exploring three threat models—singular loyalties, secret loyalties, and exclusive access—along with their estimated 10% likelihood over the next 30 years and potential mitigation strategies. Check out our sponsors: Oracle Cloud Infrastructure, Shopify. Shownotes below brought to you by Notion AI Meeting Notes - try one month for free at https://notion.com/lp/nathan Three Primary AI Coup Enablement Methods: Tom Davidson identifies singular loyalties, secret loyalties, and distributed control as the main ways AI could enable coups. Singular Loyalties Risk: AI systems explicitly programmed to be loyal to specific individuals present a significant threat, especially when AI can fully replace humans in critical roles. Secret Loyalties Threat: AI systems with hidden backdoors or "sleeper agents" that can be activated to serve particular interests represent a subtle but dangerous coup vector. Geopolitical Implications: Advanced AI capabilities could enable nations to instigate coups in other countries through secretly loyal systems or by providing exclusive AI access to specific politicians. Adversarial Testing Framework: An effective approach involves red teams attempting to produce secret loyalties while blue teams try to detect them, revealing vulnerable points in AI systems. Military Procurement Principles: Developing consensus within military communities around principles like law-following and distributed control could create safer AI procurement processes. Sponsors: Oracle Cloud Infrastructure: Oracle Cloud Infrastructure (OCI) is the next-generation cloud that delive…