# AI Agents: Substance or Snake Oil with Arvind Narayanan - #704

Page: https://stenobird.com/podcast/twiml-ai-podcast/ai-agents-substance-or-snake-oil-with-arvind-narayanan-704
Text version: https://stenobird.com/podcast/twiml-ai-podcast/ai-agents-substance-or-snake-oil-with-arvind-narayanan-704.md
Podcast: [The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)](https://stenobird.com/podcast/twiml-ai-podcast)
Published: 2024-10-07T15:32:00+00:00
Episode link: https://twimlai.com/podcast/twimlai/ai-agents-substance-or-snake-oil/
Audio file: https://pscrb.fm/rss/p/traffic.megaphone.fm/MLN2654619504.mp3?updated=1728326821
Processing state: failed
JSON: https://stenobird.com/v1/public/podcasts/twiml-ai-podcast/episodes/ai-agents-substance-or-snake-oil-with-arvind-narayanan-704
Duration seconds: 3262

## Resource

Today, we're joined by Arvind Narayanan, professor of Computer Science at Princeton University to discuss his recent works, AI Agents That Matter and AI Snake Oil. In “AI Agents That Matter”, we explore the range of agentic behaviors, the challenges in benchmarking agents, and the ‘capability and reliability gap’, which creates risks when deploying AI agents in real-world applications. We also discuss the importance of verifiers as a technique for safeguarding agent behavior. We then dig into the AI Snake Oil book, which uncovers examples of problematic and overhyped claims in AI. Arvind shares various use cases of failed applications of AI, outlines a taxonomy of AI risks, and shares his insights on AI’s catastrophic risks. Additionally, we also touched on different approaches to LLM-based reasoning, his views on tech policy and regulation, and his work on CORE-Bench, a benchmark designed to measure AI agents' accuracy in computational reproducibility tasks. The complete show notes for this episode can be found at https://twimlai.com/go/704.

## Actions

- request_transcript: `POST https://stenobird.com/v1/public/podcasts/twiml-ai-podcast/episodes/ai-agents-substance-or-snake-oil-with-arvind-narayanan-704/transcription-requests` — Idempotently request low-priority transcript generation for this episode.
- read_markdown: `GET https://stenobird.com/podcast/twiml-ai-podcast/ai-agents-substance-or-snake-oil-with-arvind-narayanan-704.md` — Read the agent-friendly Markdown representation of this episode resource.

A page view does not enqueue transcription. Agents should invoke `request_transcript` explicitly when they need this episode processed.

## Transcript

Full transcripts are not published on public pages unless there is a clear rights basis.