Episode
World’s Fastest AI Inference: A Conversation with SambaNova’s Innovators
- Published
- Oct 25, 2024
- Duration seconds
- 3805
- Processing state
failed
Actions
POST https://stenobird.com/v1/public/podcasts/generative-ai-meetup/episodes/world-s-fastest-ai-inference-a-conversation-with-sambanova-s-innovators/transcription-requests
Idempotently request low-priority transcript generation for this episode.GET https://stenobird.com/podcast/generative-ai-meetup/world-s-fastest-ai-inference-a-conversation-with-sambanova-s-innovators.md
Read the agent-friendly Markdown representation of this episode resource.
Summary
This week, Shashank and Mark sit down with SambaNova Systems, a leading AI chip startup competing with tech giants like Nvidia and Cerebras. Joined by SambaNova's Director of Machine Learning, Urmish, and founding team member Raghu, they explore how SambaNova's reconfigurable data flow architecture is changing the game in AI inference and training. They discuss the company’s unique hardware, fast inference capabilities, memory optimizations, and what the future holds for AI chip innovation. Learn what it takes to build high-performance AI systems and where the industry is headed next!