{"podcast":{"title":"Latent Space: The AI Engineer Podcast","slug":"latent-space-ai-engineer","podcast_index_feed_id":6058902,"rss_url":"https://api.substack.com/feed/podcast/1084089.rss","website_url":"https://www.latent.space/podcast","image_url":"https://substackcdn.com/feed/podcast/1084089/ca7468da5614a246d2906ee8926f6de7.jpg","author":"Latent.Space","episode_count":217,"summary":"The AI Engineer newsletter + Top technical AI podcast. How leading labs build Agents, Models, Infra, & AI for Science. See https://latent.space/about for highlights from Greg Brockman, Andrej Karpathy, George Hotz, Simon Willison, Soumith Chintala et al!","last_synced_at":"2026-08-02T15:06:40.969607+00:00","page_url":"https://stenobird.com/podcast/latent-space-ai-engineer"},"episode":{"title":"Red-Teaming after Mythos — Zico Kolter & Matt Fredrikson, Gray Swan","slug":"red-teaming-after-mythos-zico-kolter-matt-fredrikson-gray-swan","published_at":"2026-06-22T21:06:55+00:00","page_url":"https://stenobird.com/podcast/latent-space-ai-engineer/red-teaming-after-mythos-zico-kolter-matt-fredrikson-gray-swan","show_page_url":"https://stenobird.com/podcast/latent-space-ai-engineer","url":"https://www.latent.space/p/gray-swan","audio_url":"https://api.substack.com/feed/podcast/202758604/450849f7afd2f8a05057e4744d0eba68.mp3","summary":"AI agents introduce a new class of vulnerabilities, specifically indirect prompt injections, that traditional cybersecurity cannot solve. Gray Swan founders Zico Kolter and Matt Fredrikson explain why we must move beyond simple guardrails toward automated, scalable red-teaming and robust safety systems.","meta_description":"Explore the future of AI security with Gray Swan founders. Learn why indirect prompt injection is a 'gray swan' event and how to secure AI agents.","key_points":["Main idea: AI security is fundamentally different from traditional software security because models are non-deterministic and susceptible to indirect prompt injections","Failure mode: Agents that ingest external, untrusted data create a massive attack surface for attackers to hijack tool calls and leak credentials","Practical takeaway: Robustness requires specialized safety layers like 'Cygnal' that can enforce enterprise policies and generalize to new attack vectors","Main idea: The rise of 'gray swan' events—unlikely but predictable AI security breaches—is driving the need for AI insurance and compliance frameworks","Practical takeaway: Automated red-teaming and specialized models are necessary to outpace human-led adversarial attacks in complex coding environments"],"chapters":[{"start_ms":60000,"title":"The New AI Attack Surface","summary":"Defining the risks of AI agents, specifically the danger of malicious tool calls and credential theft."},{"start_ms":360000,"title":"Indirect Prompt Injection","summary":"How parsing untrusted external data allows attackers to manipulate AI systems via the network."},{"start_ms":660000,"title":"Automated Red-Teaming","summary":"The shift from manual human testing to using specialized models to find vulnerabilities at scale."},{"start_ms":960000,"title":"Mechanistic Interpretability","summary":"Discussing the potential for coding agents to turn model robustness into a measurable science."},{"start_ms":1260000,"title":"Human vs. Model Performance","summary":"Analyzing the effectiveness of different red-teaming approaches and the ranking of human testers."},{"start_ms":1560000,"title":"The Trade-off of Robustness","summary":"Balancing model capability and intelligence with the necessity of defensive guardrails."},{"start_ms":1860000,"title":"Enforcing Enterprise Policies","summary":"The difficulty of implementing specific, non-bypassable security policies within LLM prompts."}],"topics":["AI Security","Prompt Injection","Red-Teaming","AI Agents","Machine Learning Robustness","Cybersecurity","LLM Vulnerabilities","Gray Swan Events"],"duration_seconds":3983,"processing_state":"processed","actions":[{"name":"request_transcript","method":"POST","url":"https://stenobird.com/v1/public/podcasts/latent-space-ai-engineer/episodes/red-teaming-after-mythos-zico-kolter-matt-fredrikson-gray-swan/transcription-requests","description":"Idempotently request low-priority transcript generation for this episode."},{"name":"read_markdown","method":"GET","url":"https://stenobird.com/podcast/latent-space-ai-engineer/red-teaming-after-mythos-zico-kolter-matt-fredrikson-gray-swan.md","description":"Read the agent-friendly Markdown representation of this episode resource."}]}}