# Simplifying On-Device AI for Developers with Siddhika Nevrekar - #697

Page: https://stenobird.com/podcast/twiml-ai-podcast/simplifying-on-device-ai-for-developers-with-siddhika-nevrekar-697
Text version: https://stenobird.com/podcast/twiml-ai-podcast/simplifying-on-device-ai-for-developers-with-siddhika-nevrekar-697.md
Podcast: [The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)](https://stenobird.com/podcast/twiml-ai-podcast)
Published: 2024-08-12T18:07:00+00:00
Episode link: https://twimlai.com/podcast/twimlai/simplifying-on-device-ai-for-developers/
Audio file: https://pscrb.fm/rss/p/traffic.megaphone.fm/MLN7180381574.mp3?updated=1723486873
Processing state: failed
JSON: https://stenobird.com/v1/public/podcasts/twiml-ai-podcast/episodes/simplifying-on-device-ai-for-developers-with-siddhika-nevrekar-697
Duration seconds: 2797

## Resource

Today, we're joined by Siddhika Nevrekar, AI Hub head at Qualcomm Technologies, to discuss on-device AI and how to make it easier for developers to take advantage of device capabilities. We unpack the motivations for AI engineers to move model inference from the cloud to local devices, and explore the challenges associated with on-device AI. We dig into the role of hardware solutions, from powerful system-on-chips (SoC) to neural processors, the importance of collaboration between community runtimes like ONNX and TFLite and chip manufacturers, the unique challenges of IoT and autonomous vehicles, and the key metrics developers should focus on to ensure optimal on-device performance. Finally, Siddhika introduces Qualcomm's AI Hub, a platform developed to simplify the process of testing and optimizing AI models across different devices. The complete show notes for this episode can be found at https://twimlai.com/go/697.

## Actions

- request_transcript: `POST https://stenobird.com/v1/public/podcasts/twiml-ai-podcast/episodes/simplifying-on-device-ai-for-developers-with-siddhika-nevrekar-697/transcription-requests` — Idempotently request low-priority transcript generation for this episode.
- read_markdown: `GET https://stenobird.com/podcast/twiml-ai-podcast/simplifying-on-device-ai-for-developers-with-siddhika-nevrekar-697.md` — Read the agent-friendly Markdown representation of this episode resource.

A page view does not enqueue transcription. Agents should invoke `request_transcript` explicitly when they need this episode processed.

## Transcript

Full transcripts are not published on public pages unless there is a clear rights basis.