# RAG Risks: Why Retrieval-Augmented LLMs are Not Safer with Sebastian Gehrmann - #732

Page: https://stenobird.com/podcast/twiml-ai-podcast/rag-risks-why-retrieval-augmented-llms-are-not-safer-with-sebastian-gehrmann-732
Text version: https://stenobird.com/podcast/twiml-ai-podcast/rag-risks-why-retrieval-augmented-llms-are-not-safer-with-sebastian-gehrmann-732.md
Podcast: [The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)](https://stenobird.com/podcast/twiml-ai-podcast)
Published: 2025-05-21T18:14:00+00:00
Episode link: https://twimlai.com/podcast/twimlai/rag-risks-why-retrieval-augmented-llms-are-not-safer/
Audio file: https://pscrb.fm/rss/p/traffic.megaphone.fm/MLN9960265469.mp3?updated=1747852071
Processing state: failed
JSON: https://stenobird.com/v1/public/podcasts/twiml-ai-podcast/episodes/rag-risks-why-retrieval-augmented-llms-are-not-safer-with-sebastian-gehrmann-732
Duration seconds: 3429

## Resource

Today, we're joined by Sebastian Gehrmann, head of responsible AI in the Office of the CTO at Bloomberg, to discuss AI safety in retrieval-augmented generation (RAG) systems and generative AI in high-stakes domains like financial services. We explore how RAG, contrary to some expectations, can inadvertently degrade model safety. We cover examples of unsafe outputs that can emerge from these systems, different approaches to evaluating these safety risks, and the potential reasons behind this counterintuitive behavior. Shifting to the application of generative AI in financial services, Sebastian outlines a domain-specific safety taxonomy designed for the industry's unique needs. We also explore the critical role of governance and regulatory frameworks in addressing these concerns, the role of prompt engineering in bolstering safety, Bloomberg’s multi-layered mitigation strategies, and vital areas for further work in improving AI safety within specialized domains. The complete show notes for this episode can be found at https://twimlai.com/go/732.

## Actions

- request_transcript: `POST https://stenobird.com/v1/public/podcasts/twiml-ai-podcast/episodes/rag-risks-why-retrieval-augmented-llms-are-not-safer-with-sebastian-gehrmann-732/transcription-requests` — Idempotently request low-priority transcript generation for this episode.
- read_markdown: `GET https://stenobird.com/podcast/twiml-ai-podcast/rag-risks-why-retrieval-augmented-llms-are-not-safer-with-sebastian-gehrmann-732.md` — Read the agent-friendly Markdown representation of this episode resource.

A page view does not enqueue transcription. Agents should invoke `request_transcript` explicitly when they need this episode processed.

## Transcript

Full transcripts are not published on public pages unless there is a clear rights basis.