{"podcast":{"title":"Future of Life Institute Podcast","slug":"future-of-life-institute-podcast-1112471","podcast_index_feed_id":1112471,"rss_url":"https://feeds.transistor.fm/future-of-life-institute-podcast-4e4d1fa5-a878-4cb2-91be-91c3ce266dfd","website_url":"http://podcast.futureoflife.org","image_url":"https://img.transistorcdn.com/J_n37RCZqjxGWjRTeSwa1kYSzes1V2OR3ShI3uGkwh8/rs:fill:0:0:1/w:1400/h:1400/q:60/mb:500000/aHR0cHM6Ly9pbWct/dXBsb2FkLXByb2R1/Y3Rpb24udHJhbnNp/c3Rvci5mbS81MmU5/MDZjZGQ5OTI0MDc5/YTk2ZTAxYTgwYTNk/M2VlOC5qcGc.jpg","author":"Future of Life Institute","episode_count":271,"summary":"The Future of Life Institute (FLI) is a nonprofit working to reduce global catastrophic and existential risk from powerful technologies. In particular, FLI focuses on risks from artificial intelligence (AI), biotechnology, nuclear weapons and climate change. The Institute's work is made up of three main strands: grantmaking for risk reduction, educational outreach, and advocacy within the United Nations, US government and European Union institutions. FLI has become one of the world's leading voices on the governance of AI having created one of the earliest and most influential sets of governance principles: the Asilomar AI Principles.","last_synced_at":"2026-07-01T06:20:26.948551+00:00","page_url":"https://stenobird.com/podcast/future-of-life-institute-podcast-1112471"},"episode":{"title":"How to Avoid Two AI Catastrophes: Domination and Chaos (with Nora Ammann)","slug":"how-to-avoid-two-ai-catastrophes-domination-and-chaos-with-nora-ammann","published_at":"2026-01-07T10:55:21+00:00","page_url":"https://stenobird.com/podcast/future-of-life-institute-podcast-1112471/how-to-avoid-two-ai-catastrophes-domination-and-chaos-with-nora-ammann","show_page_url":"https://stenobird.com/podcast/future-of-life-institute-podcast-1112471","url":"https://share.transistor.fm/s/d9cb81de","audio_url":"https://media.transistor.fm/d9cb81de/78abb399.mp3","summary":"Nora Ammann is a technical specialist at the Advanced Research and Invention Agency in the UK. She joins the podcast to discuss how to steer a slow AI takeoff toward resilient and cooperative futures. We examine risks of rogue AI and runaway competition, and how scalable oversight, formal guarantees and secure code could support AI-enabled R&amp;D and critical infrastructure. Nora also explains AI-supported bargaining and public goods for stability. LINKS: Nora Ammann site ARIA safeguarded AI program page AI Resilience official site Gradual Disempowerment website CHAPTERS: (00:00) Episode Preview (01:00) Slow takeoff expectations (08:13) Domination versus chaos (17:18) Human-AI coalitions vision (28:14) Scaling oversight and agents (38:45) Formal specs and guarantees (51:10) Resilience in AI era (01:02:21) Defense-favored cyber systems (01:10:37) AI-enabled bargaining and trade PRODUCED BY: https://aipodcast.ing SOCIAL LINKS: Website: https://podcast.futureoflife.org Twitter (FLI): https://x.com/FLI_org Twitter (Gus): https://x.com/gusdocker LinkedIn: https://www.linkedin.com/company/future-of-life-institute/ YouTube: https://www.youtube.com/channel/UC-rCCy3FQ-GItDimSR9lhzw/ Apple: https://geo.itunes.apple.com/us/podcast/id1170991978 Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP","meta_description":"Nora Ammann is a technical specialist at the Advanced Research and Invention Agency in the UK. She joins the podcast to discuss how to steer a slow AI tak…","key_points":[],"chapters":[],"topics":[],"duration_seconds":4801,"processing_state":"not_requested","actions":[{"name":"request_transcript","method":"POST","url":"https://stenobird.com/v1/public/podcasts/future-of-life-institute-podcast-1112471/episodes/how-to-avoid-two-ai-catastrophes-domination-and-chaos-with-nora-ammann/transcription-requests","description":"Idempotently request low-priority transcript generation for this episode."},{"name":"read_markdown","method":"GET","url":"https://stenobird.com/podcast/future-of-life-institute-podcast-1112471/how-to-avoid-two-ai-catastrophes-domination-and-chaos-with-nora-ammann.md","description":"Read the agent-friendly Markdown representation of this episode resource."}]}}