{"podcast":{"title":"Scaling DevTools","slug":"scaling-devtools","podcast_index_feed_id":5370747,"rss_url":"https://feeds.transistor.fm/scaling-devtools","website_url":"http://scalingdevtools.com","image_url":"https://img.transistorcdn.com/HkfKelaid_fFruHof3T1113FnoaMA6qHS5kMN568xTo/rs:fill:0:0:1/w:1400/h:1400/q:60/mb:500000/aHR0cHM6Ly9pbWct/dXBsb2FkLXByb2R1/Y3Rpb24udHJhbnNp/c3Rvci5mbS9zaG93/LzI5MTkzLzE2NDk3/Nzk2NDAtYXJ0d29y/ay5qcGc.jpg","author":"Scaling DevTools","episode_count":188,"summary":"We investigate what it takes to grow developer tools and AI DevTools. Topics include developer marketing, DevRel, developer advocacy and developer experience. Featuring founders and key people from the likes of Vercel, ElevenLabs and OpenAI. Scaling DevTools is sponsored by WorkOS.","last_synced_at":null,"page_url":"https://stenobird.com/podcast/scaling-devtools"},"episode":{"title":"Baseten CEO and co-founder Tuhin Srivastava on inference and feedback loops","slug":"baseten-ceo-and-co-founder-tuhin-srivastava-on-inference-and-feedback-loops","published_at":"2025-11-14T17:29:17+00:00","page_url":"https://stenobird.com/podcast/scaling-devtools/baseten-ceo-and-co-founder-tuhin-srivastava-on-inference-and-feedback-loops","show_page_url":"https://stenobird.com/podcast/scaling-devtools","url":"https://podcast.scalingdevtools.com/episodes/scaling-ai-infrastructure-with-basetens-tuhin-srivastava","audio_url":"https://media.transistor.fm/5e289b9a/31f1913a.mp3","summary":"Baseten CEO Tuhin Srivastava discusses the strategic shift from building ML primitives to scaling a high-growth GenAI inference platform. He explores how to navigate rapid market shifts by prioritizing developer experience and tight customer feedback loops.","meta_description":"Baseten CEO Tuhin Srivastava shares insights on scaling AI infrastructure, managing rapid growth, and the importance of developer experience in GenAI.","key_points":["Main idea: As model capabilities commoditize, the real value shifts to the underlying inference infrastructure and developer experience","Practical takeaway: Minimize the distance between you and your customers to create ultra-fast feedback loops","Failure mode: Avoid making irreversible early architectural abstractions before you have fully honed the product's developer experience","Strategic insight: The future of enterprise software lies in being either AI-first or AI-enabled, driving massive demand for inference-centric tools","Product philosophy: Focus on making the easy things easy and the hard things possible without blocking the developer's workflow"],"chapters":[{"start_ms":60000,"title":"The Pre-GenAI Build Phase","summary":"Reflecting on the years spent building machine learning primitives before the massive market demand arrived in 2023."},{"start_ms":165000,"title":"Navigating Market Shifts","summary":"How Baseten repositioned itself to meet the sudden explosion of interest in generative AI."},{"start_ms":485000,"title":"The Power of Feedback Loops","summary":"Why small companies must prioritize direct, rapid communication with customers to iterate effectively."},{"start_ms":700000,"title":"The Future of Inference","summary":"Discussing why every company will eventually need inference-based infrastructure as models become commoditized."},{"start_ms":920000,"title":"Prioritizing Developer Experience","summary":"The importance of building tools that provide observability and ease of use without creating friction."},{"start_ms":1245000,"title":"Advice for DevTool Founders","summary":"Lessons on managing early technical decisions and the importance of staying close to the user."}],"topics":["GenAI","Inference Infrastructure","Developer Experience","Machine Learning","DevTools","Scaling Startups","Cloud Computing","Software Engineering"],"duration_seconds":1451,"processing_state":"processed","actions":[{"name":"request_transcript","method":"POST","url":"https://stenobird.com/v1/public/podcasts/scaling-devtools/episodes/baseten-ceo-and-co-founder-tuhin-srivastava-on-inference-and-feedback-loops/transcription-requests","description":"Idempotently request low-priority transcript generation for this episode."},{"name":"read_markdown","method":"GET","url":"https://stenobird.com/podcast/scaling-devtools/baseten-ceo-and-co-founder-tuhin-srivastava-on-inference-and-feedback-loops.md","description":"Read the agent-friendly Markdown representation of this episode resource."}]}}