# 127. Matthew Stewart - The emerging world of ML sensors

Page: https://stenobird.com/podcast/towards-data-science/127-matthew-stewart-the-emerging-world-of-ml-sensors
Text version: https://stenobird.com/podcast/towards-data-science/127-matthew-stewart-the-emerging-world-of-ml-sensors.md
Podcast: [Towards Data Science](https://stenobird.com/podcast/towards-data-science)
Published: 2022-09-21T13:58:52+00:00
Episode link: https://podcasters.spotify.com/pod/show/towardsdatascience/episodes/127--Matthew-Stewart---The-emerging-world-of-ML-sensors-e1o2btu
Audio file: https://anchor.fm/s/36b4844/podcast/play/57798014/https%3A%2F%2Fd3ctxlq1ktw2nl.cloudfront.net%2Fstaging%2F2022-8-19%2Fc38648a4-bf32-6b56-1266-16db5905d32d.m4a
Processing state: failed
JSON: https://stenobird.com/v1/public/podcasts/towards-data-science/episodes/127-matthew-stewart-the-emerging-world-of-ml-sensors
Duration seconds: 2494

## Resource

Today, we live in the era of AI scaling. It seems like everywhere you look people are pushing to make large language models larger, or more multi-modal and leveraging ungodly amounts of processing power to do it. But although that’s one of the defining trends of the modern AI era, it’s not the only one. At the far opposite extreme from the world of hyperscale transformers and giant dense nets is the fast-evolving world of TinyML, where the goal is to pack AI systems onto small edge devices. My guest today is Matthew Stewart , a deep learning and TinyML researcher at Harvard University, where he collaborates with the world’s leading IoT and TinyML experts on projects aimed at getting small devices to do big things with AI. Recently, along with his colleagues, Matt co-authored a paper that introduced a new way of thinking about sensing. The idea is to tightly integrate machine learning and sensing on one device. For example, today we might have a sensor like a camera embedded on an edge device, and that camera would have to send data about all the pixels in its field of view back to a central server that might take that data and use it to perform a task like facial recognition. But that’s not great because it involves sending potentially sensitive data — in this case, images of people’s faces — from an edge device to a server, introducing security risks. So instead, what if the camera’s output was processed on the edge device itself, so that all that had to be sent to the server was much less sensitive information, like whether or not a given face was detected? These systems — where edge devices harness onboard AI, and share only processed outputs with the rest of the world — are what Matt and his colleagues call ML sensors . ML sensors really do seem like they’ll be par…

## Actions

- request_transcript: `POST https://stenobird.com/v1/public/podcasts/towards-data-science/episodes/127-matthew-stewart-the-emerging-world-of-ml-sensors/transcription-requests` — Idempotently request low-priority transcript generation for this episode.
- read_markdown: `GET https://stenobird.com/podcast/towards-data-science/127-matthew-stewart-the-emerging-world-of-ml-sensors.md` — Read the agent-friendly Markdown representation of this episode resource.

A page view does not enqueue transcription. Agents should invoke `request_transcript` explicitly when they need this episode processed.

## Transcript

Full transcripts are not published on public pages unless there is a clear rights basis.