# 94% CAGR: What the Inference Boom means for your AI costs | Vamshi Ambati

Page: https://stenobird.com/podcast/the-neon-show-862453/94-cagr-what-the-inference-boom-means-for-your-ai-costs-vamshi-ambati
Text version: https://stenobird.com/podcast/the-neon-show-862453/94-cagr-what-the-inference-boom-means-for-your-ai-costs-vamshi-ambati.md
Podcast: [The Neon Show](https://stenobird.com/podcast/the-neon-show-862453)
Published: 2026-06-09T13:30:00+00:00
Episode link: https://www.buzzsprout.com/1601695/episodes/19319161-94-cagr-what-the-inference-boom-means-for-your-ai-costs-vamshi-ambati.mp3
Audio file: https://www.buzzsprout.com/1601695/episodes/19319161-94-cagr-what-the-inference-boom-means-for-your-ai-costs-vamshi-ambati.mp3
Processing state: not_requested
JSON: https://stenobird.com/v1/public/podcasts/the-neon-show-862453/episodes/94-cagr-what-the-inference-boom-means-for-your-ai-costs-vamshi-ambati
Duration seconds: 3116

## Resource

Vamshi Ambati has spent more than two decades in AI, through the symbolic era, statistical era, and the neural wave we're experiencing today. A CMU PhD, founder of LatentStructure and Predera (which was acquired), now an investor at Virama Ventures, he's one of the sharper voices on what's actually happening under the hood of the AI boom. We discuss a simple question: Who wins when models become cheaper and more abundant? And try to answer this by looking at how inference spend v/s comp...

## Actions

- request_transcript: `POST https://stenobird.com/v1/public/podcasts/the-neon-show-862453/episodes/94-cagr-what-the-inference-boom-means-for-your-ai-costs-vamshi-ambati/transcription-requests` — Idempotently request low-priority transcript generation for this episode.
- read_markdown: `GET https://stenobird.com/podcast/the-neon-show-862453/94-cagr-what-the-inference-boom-means-for-your-ai-costs-vamshi-ambati.md` — Read the agent-friendly Markdown representation of this episode resource.

A page view does not enqueue transcription. Agents should invoke `request_transcript` explicitly when they need this episode processed.

## Transcript

Full transcripts are not published on public pages unless there is a clear rights basis.