Episode
How 24,000 companies keep their AI from Breaking in Production | Rohit Agarwal, Portkey
- Podcast
- The Neon Show
- Published
- Mar 19, 2026
- Duration seconds
- 4724
- Processing state
not_requested
Actions
POST https://stenobird.com/v1/public/podcasts/the-neon-show-862453/episodes/how-24-000-companies-keep-their-ai-from-breaking-in-production-rohit-agarwal-portkey/transcription-requests
Idempotently request low-priority transcript generation for this episode.GET https://stenobird.com/podcast/the-neon-show-862453/how-24-000-companies-keep-their-ai-from-breaking-in-production-rohit-agarwal-portkey.md
Read the agent-friendly Markdown representation of this episode resource.
Summary
Over 1 Trillion AI tokens pass through Portkey every single day. Every AI product eventually runs into the same problem. The prototype works, but once it goes live the system has to manage multiple models, rising token costs, unpredictable latency, and infrastructure that was never built for AI workloads. That is the problem Rohit Agarwal is solving with Portkey, an AI gateway that sits between applications and the models, whether that’s GPT-4, Claude, or Gemini. With 24,000 companies routing...