# Expert Insights On Retrieval Augmented Generation And How To Build It

Page: https://stenobird.com/podcast/ai-engineering-podcast/expert-insights-on-retrieval-augmented-generation-and-how-to-build-it
Text version: https://stenobird.com/podcast/ai-engineering-podcast/expert-insights-on-retrieval-augmented-generation-and-how-to-build-it.md
Podcast: [AI Engineering Podcast](https://stenobird.com/podcast/ai-engineering-podcast)
Published: 2024-07-28T20:10:28+00:00
Episode link: https://www.aiengineeringpodcast.com/retrieval-augmented-generation-implementation-episode-34
Audio file: https://op3.dev/e/dts.podtrac.com/redirect.mp3/serve.podhome.fm/episode/f6ff0caa-931b-4c08-bfdd-08dc7f5cd336/6385754419563965321c5152b9-c566-4436-97d8-b27753298092v1.mp3
Processing state: failed
JSON: https://stenobird.com/v1/public/podcasts/ai-engineering-podcast/episodes/expert-insights-on-retrieval-augmented-generation-and-how-to-build-it
Duration seconds: 3801

## Resource

Summary In this episode we're joined by Matt Zeiler, founder and CEO of Clarifai, as he dives into the technical aspects of retrieval augmented generation (RAG). From his journey into AI at the University of Toronto to founding one of the first deep learning AI companies, Matt shares his insights on the evolution of neural networks and generative models over the last 15 years. He explains how RAG addresses issues with large language models, including data staleness and hallucinations, by providing dynamic access to information through vector databases and embedding models. Throughout the conversation, Matt and host Tobias Macy discuss everything from architectural requirements to operational considerations, as well as the practical applications of RAG in industries like intelligence, healthcare, and finance. Tune in for a comprehensive look at RAG and its future trends in AI. Announcements Hello and welcome to the AI Engineering Podcast, your guide to the fast-moving world of building scalable and maintainable AI systems Your host is Tobias Macey and today I'm interviewing Matt Zeiler, Founder & CEO of Clarifai, about the technical aspects of RAG, including the architectural requirements, edge cases, and evolutionary characteristics Interview Introduction How did you get involved in the area of data management? Can you describe what RAG (Retrieval Augmented Generation) is? What are the contexts in which you would want to use RAG? What are the alternatives to RAG? What are the architectural/technical components that are required for production grade RAG? Getting a quick proof-of-concept working for RAG is fairly straightforward. What are the failures modes/edge cases that start to surface as you scale the usage and complexity? The first step of building the corpus f…

## Actions

- request_transcript: `POST https://stenobird.com/v1/public/podcasts/ai-engineering-podcast/episodes/expert-insights-on-retrieval-augmented-generation-and-how-to-build-it/transcription-requests` — Idempotently request low-priority transcript generation for this episode.
- read_markdown: `GET https://stenobird.com/podcast/ai-engineering-podcast/expert-insights-on-retrieval-augmented-generation-and-how-to-build-it.md` — Read the agent-friendly Markdown representation of this episode resource.

A page view does not enqueue transcription. Agents should invoke `request_transcript` explicitly when they need this episode processed.

## Transcript

Full transcripts are not published on public pages unless there is a clear rights basis.