# REFRAG with Xiaoqiang Lin - Weaviate Podcast #130!

Page: https://stenobird.com/podcast/weaviate-podcast-6288219/refrag-with-xiaoqiang-lin-weaviate-podcast-130
Text version: https://stenobird.com/podcast/weaviate-podcast-6288219/refrag-with-xiaoqiang-lin-weaviate-podcast-130.md
Podcast: [Weaviate Podcast](https://stenobird.com/podcast/weaviate-podcast-6288219)
Published: 2025-11-03T14:43:27+00:00
Episode link: https://podcasters.spotify.com/pod/show/weaviate/episodes/REFRAG-with-Xiaoqiang-Lin---Weaviate-Podcast-130-e3aed71
Audio file: https://anchor.fm/s/cffc3468/podcast/play/110621345/https%3A%2F%2Fd3ctxlq1ktw2nl.cloudfront.net%2Fstaging%2F2025-10-3%2F3d74fb76-765f-55fb-e56c-806a99fdcfe2.mp3
Processing state: not_requested
JSON: https://stenobird.com/v1/public/podcasts/weaviate-podcast-6288219/episodes/refrag-with-xiaoqiang-lin-weaviate-podcast-130
Duration seconds: 3600

## Resource

Xiaoqiang Lin is a Ph.D. student at the National University of Singapore. During his time at Meta, Xiaoqiang lead the research behind REFRAG: Rethinking RAG-based Decoding. Traditional RAG systems use vectors to retrieve relevant context with semantic search, but then throw away the vectors when passing the context to the LLM. REFRAG instead feeds the LLM these pre-compute vectors, achieving massive gains in long context processing and LLM inference speed! REFRAG makes Time-To-First-Token (TTFT) 31x faster and Time-To-Iterative-Token (TTIT) 3x faster, boosting overall LLM throughput by 7x while also being able to handle much longer contexts! There are so many interesting aspects to this and I really loved diving into the details with Xiaoqiang! I hope you enjoy the podcast!

## Actions

- request_transcript: `POST https://stenobird.com/v1/public/podcasts/weaviate-podcast-6288219/episodes/refrag-with-xiaoqiang-lin-weaviate-podcast-130/transcription-requests` — Idempotently request low-priority transcript generation for this episode.
- read_markdown: `GET https://stenobird.com/podcast/weaviate-podcast-6288219/refrag-with-xiaoqiang-lin-weaviate-podcast-130.md` — Read the agent-friendly Markdown representation of this episode resource.

A page view does not enqueue transcription. Agents should invoke `request_transcript` explicitly when they need this episode processed.

## Transcript

Full transcripts are not published on public pages unless there is a clear rights basis.