{"podcast":{"title":"Code Story: Insights from Startup Tech Leaders","slug":"code-story","podcast_index_feed_id":735330,"rss_url":"https://feeds.redcircle.com/ac5e79a4-0405-49a3-af2c-02c37f0b3879","website_url":"https://codestory.co/","image_url":"https://media.redcircle.com/images/2025/5/14/20/c82c3282-f0a8-4b37-b210-96f7da10be1e_4061-b148-29cd200c3504_full_1568830220-artwork.jpg","author":"Noah Labhart - Startup Founder & CTO","episode_count":793,"summary":"Code Story is a startup podcast for technical founders building and scaling software products. Each episode features SaaS founders, engineers, and product leaders sharing how they built their product, found product-market fit, and navigated early-stage growth. We explore: Early engineering decisions and MVP development Landing the first customers Pricing and go-to-market experiments Scaling challenges and infrastructure bottlenecks Hiring the first team Lessons learned from growing a startup From first commit to first scale, Code Story focuses on the critical transition from building software to building a scalable business. If you’re a founder, engineer, or product leader interested in SaaS, startups, and scaling technology companies, this podcast breaks down how great products are built — and how they grow.","last_synced_at":null,"page_url":"https://stenobird.com/podcast/code-story"},"episode":{"title":"S12 E16: Nikunj Bajaj, True Foundry","slug":"s12-e16-nikunj-bajaj-true-foundry","published_at":"2026-04-28T10:00:16+00:00","page_url":"https://stenobird.com/podcast/code-story/s12-e16-nikunj-bajaj-true-foundry","show_page_url":"https://stenobird.com/podcast/code-story","url":"https://codestory.co/podcast/e16-nikunj-bajaj-true-foundry/","audio_url":"https://pdst.fm/e/pscrb.fm/rss/p/audio4.redcircle.com/episodes/7deaad27-2d92-4f67-8da5-1709162da475/stream.mp3","summary":"Nikunj Bajaj explains how True Foundry built an enterprise-grade AI gateway using a split-plane architecture to manage LLM and agent traffic. He details the transition from Meta engineer to founder, focusing on the infrastructure needs of the upcoming agentic application era.","meta_description":"Learn how True Foundry uses split-plane architecture and Kubernetes to build scalable, high-availability AI gateways for LLMs and agents.","key_points":["Main idea: True Foundry utilizes a split-plane architecture to separate the control plane from the gateway plane, ensuring high availability in the critical request path","Practical takeaway: Building on Kubernetes allows startups to leverage existing enterprise standards and community-driven scaling capabilities","Failure mode: Relying on fragile, non-standardized infrastructure can lead to downtime in production-critical AI agent applications","Strategic insight: The future of AI infrastructure lies in becoming a central compute orchestration platform, similar to the evolution of Snowflake for data","Foundational principle: Long-term entrepreneurial success depends on building a reputation for radical transparency and ownership of mistakes"],"chapters":[{"start_ms":60000,"title":"Split-Plane Architecture","summary":"Introduction to the design principle of separating the control plane from the gateway plane to ensure reliability."},{"start_ms":420000,"title":"The Unified AI Stack","summary":"Discussing the vertically stacked platform approach involving software, machine learning, and underlying infrastructure."},{"start_ms":590000,"title":"Betting on Kubernetes","summary":"Why investing in Kubernetes-based machine learning infrastructure was a strategic move as other platforms declined."},{"start_ms":1300000,"title":"Achieving Low Latency at Scale","summary":"How the gateway maintains sub-second latency while handling tens of thousands of requests per second across 17 regions."},{"start_ms":1670000,"title":"Lessons in Entrepreneurship","summary":"Reflecting on early mistakes and the importance of maintaining a consistent architectural foundation."},{"start_ms":2030000,"title":"The Vision for Compute Orchestration","summary":"Comparing the future of True Foundry to the rise of data warehouses like Databricks and Snowflake."},{"start_ms":2220000,"title":"Building Mission-Driven Teams","summary":"How a clear problem statement and founder dedication drive team resilience during startup rough patches."}],"topics":["AI Gateway","LLM Infrastructure","Kubernetes","Split-plane architecture","Agentic applications","Machine Learning Operations","Startup scaling","Cloud computing"],"duration_seconds":1956,"processing_state":"processed","actions":[{"name":"request_transcript","method":"POST","url":"https://stenobird.com/v1/public/podcasts/code-story/episodes/s12-e16-nikunj-bajaj-true-foundry/transcription-requests","description":"Idempotently request low-priority transcript generation for this episode."},{"name":"read_markdown","method":"GET","url":"https://stenobird.com/podcast/code-story/s12-e16-nikunj-bajaj-true-foundry.md","description":"Read the agent-friendly Markdown representation of this episode resource."}]}}