# Sayash Kapoor - How seriously should we take AI X-risk? (ICML 1/13)

Page: https://stenobird.com/podcast/machine-learning-street-talk/sayash-kapoor-how-seriously-should-we-take-ai-x-risk-icml-1-13
Text version: https://stenobird.com/podcast/machine-learning-street-talk/sayash-kapoor-how-seriously-should-we-take-ai-x-risk-icml-1-13.md
Podcast: [Machine Learning Street Talk (MLST)](https://stenobird.com/podcast/machine-learning-street-talk)
Published: 2024-07-28T16:14:17+00:00
Episode link: https://podcasters.spotify.com/pod/show/machinelearningstreettalk/episodes/Sayash-Kapoor---How-seriously-should-we-take-AI-X-risk--ICML-113-e2mhuoc
Audio file: https://anchor.fm/s/1e4a0eac/podcast/play/89766092/https%3A%2F%2Fd3ctxlq1ktw2nl.cloudfront.net%2Fstaging%2F2024-6-28%2Fc7d57c66-93af-1ac3-0a5c-b62ccdcdd61b.mp3
Processing state: processed
JSON: https://stenobird.com/v1/public/podcasts/machine-learning-street-talk/episodes/sayash-kapoor-how-seriously-should-we-take-ai-x-risk-icml-1-13
Duration seconds: 2982

## Resource

How seriously should governments take the threat of existential risk from AI, given the lack of consensus among researchers? On the one hand, existential risks (x-risks) are necessarily somewhat speculative: by the time there is concrete evidence, it may be too late. On the other hand, governments must prioritize — after all, they don’t worry too much about x-risk from alien invasions. MLST is sponsored by Brave: The Brave Search API covers over 20 billion webpages, built from scratch without Big Tech biases or the recent extortionate price hikes on search API access. Perfect for AI model training and retrieval augmentated generation. Try it now - get 2,000 free queries monthly at brave.com/api. Sayash Kapoor is a computer science Ph.D. candidate at Princeton University's Center for Information Technology Policy. His research focuses on the societal impact of AI. Kapoor has previously worked on AI in both industry and academia, with experience at Facebook, Columbia University, and EPFL Switzerland. He is a recipient of a best paper award at ACM FAccT and an impact recognition award at ACM CSCW. Notably, Kapoor was included in TIME's inaugural list of the 100 most influential people in AI. Sayash Kapoor https://x.com/sayashk https://www.cs.princeton.edu/~sayashk/ Arvind Narayanan (other half of the AI Snake Oil duo) https://x.com/random_walker AI existential risk probabilities are too unreliable to inform policy https://www.aisnakeoil.com/p/ai-existential-risk-probabilities Pre-order AI Snake Oil Book https://amzn.to/4fq2HGb AI Snake Oil blog https://www.aisnakeoil.com/ AI Agents That Matter https://arxiv.org/abs/2407.01502 Shortcut learning in deep neural networks https://www.semanticscholar.org/paper/Shortcut-learning-in-deep-neural-networks-Geirhos-Jacobsen/1b04936c2…

## Actions

- request_transcript: `POST https://stenobird.com/v1/public/podcasts/machine-learning-street-talk/episodes/sayash-kapoor-how-seriously-should-we-take-ai-x-risk-icml-1-13/transcription-requests` — Idempotently request low-priority transcript generation for this episode.
- read_markdown: `GET https://stenobird.com/podcast/machine-learning-street-talk/sayash-kapoor-how-seriously-should-we-take-ai-x-risk-icml-1-13.md` — Read the agent-friendly Markdown representation of this episode resource.

A page view does not enqueue transcription. Agents should invoke `request_transcript` explicitly when they need this episode processed.

## Transcript

Full transcripts are not published on public pages unless there is a clear rights basis.