Episode
Simplifying On-Device AI for Developers with Siddhika Nevrekar - #697
- Published
- Aug 12, 2024
- Duration seconds
- 2797
- Processing state
failed
Actions
POST https://stenobird.com/v1/public/podcasts/twiml-ai-podcast/episodes/simplifying-on-device-ai-for-developers-with-siddhika-nevrekar-697/transcription-requests
Idempotently request low-priority transcript generation for this episode.GET https://stenobird.com/podcast/twiml-ai-podcast/simplifying-on-device-ai-for-developers-with-siddhika-nevrekar-697.md
Read the agent-friendly Markdown representation of this episode resource.
Summary
Today, we're joined by Siddhika Nevrekar, AI Hub head at Qualcomm Technologies, to discuss on-device AI and how to make it easier for developers to take advantage of device capabilities. We unpack the motivations for AI engineers to move model inference from the cloud to local devices, and explore the challenges associated with on-device AI. We dig into the role of hardware solutions, from powerful system-on-chips (SoC) to neural processors, the importance of collaboration between community runtimes like ONNX and TFLite and chip manufacturers, the unique challenges of IoT and autonomous vehicles, and the key metrics developers should focus on to ensure optimal on-device performance. Finally, Siddhika introduces Qualcomm's AI Hub, a platform developed to simplify the process of testing and optimizing AI models across different devices. The complete show notes for this episode can be found at https://twimlai.com/go/697.