Episode
Kubernetes, Compliance, and Control: The Operational Backbone of AI Sovereignty
- Podcast
- AI Engineering Podcast
- Published
- Feb 25, 2026
- Duration seconds
- 3676
- Processing state
processed
Actions
POST https://stenobird.com/v1/public/podcasts/ai-engineering-podcast/episodes/kubernetes-compliance-and-control-the-operational-backbone-of-ai-sovereignty/transcription-requests
Idempotently request low-priority transcript generation for this episode.GET https://stenobird.com/podcast/ai-engineering-podcast/kubernetes-compliance-and-control-the-operational-backbone-of-ai-sovereignty.md
Read the agent-friendly Markdown representation of this episode resource.
Summary
Summary In this episode of the AI Engineering Podcast, Steven Watt, leader of the Office of the CTO at Red Hat, discusses practical paths to achieving AI sovereignty for organizations. He shares his two-decade experience in AI, highlighting how governments are building GPU platforms and protected data hubs to maintain control over AI workloads. Steve emphasizes why self-managed infrastructure is becoming a strategic necessity as companies outgrow cloud costs and require tighter control over models, data, and compliance. The conversation explores the operational substrate for AI sovereignty, including Kubernetes as the scale-out backbone for LLM serving, bridging the gap with PyTorch ecosystems, observability and policy for non-deterministic systems, and emerging security needs such as confidential inference and agentic identity. They also discuss model and hardware optionality (GPUs, CPUs, and new accelerators), the growing demand for energy-efficient inference, and the importance of open models and post-training to create durable differentiation. Steve identifies access to GPUs as the biggest gap hindering sovereign AI adoption today, emphasizing the need for broad access to GPUs for AI workloads to thrive. The conversation also touches on evolving architectures beyond transformers, the interplay between AI and data sovereignty, consolidation pressures from pilot chaos to standardized platforms, and the societal triad of universities, startups, and sovereign infrastructure. Announcements Hello and welcome to the AI Engineering Podcast, your guide to the fast-moving world of building scalable and maintainable AI systems Unlock the full potential of your AI workloads with a seamless and composable data infrastructure. Bruin is an open source framework…