Episode
94% CAGR: What the Inference Boom means for your AI costs | Vamshi Ambati
- Podcast
- The Neon Show
- Published
- Jun 9, 2026
- Duration seconds
- 3116
- Processing state
not_requested
Actions
POST https://stenobird.com/v1/public/podcasts/the-neon-show-862453/episodes/94-cagr-what-the-inference-boom-means-for-your-ai-costs-vamshi-ambati/transcription-requests
Idempotently request low-priority transcript generation for this episode.GET https://stenobird.com/podcast/the-neon-show-862453/94-cagr-what-the-inference-boom-means-for-your-ai-costs-vamshi-ambati.md
Read the agent-friendly Markdown representation of this episode resource.
Summary
Vamshi Ambati has spent more than two decades in AI, through the symbolic era, statistical era, and the neural wave we're experiencing today. A CMU PhD, founder of LatentStructure and Predera (which was acquired), now an investor at Virama Ventures, he's one of the sharper voices on what's actually happening under the hood of the AI boom. We discuss a simple question: Who wins when models become cheaper and more abundant? And try to answer this by looking at how inference spend v/s comp...