# Decoding Animal Behavior to Train Robots with EgoPet with Amir Bar - #692

Page: https://stenobird.com/podcast/twiml-ai-podcast/decoding-animal-behavior-to-train-robots-with-egopet-with-amir-bar-692
Text version: https://stenobird.com/podcast/twiml-ai-podcast/decoding-animal-behavior-to-train-robots-with-egopet-with-amir-bar-692.md
Podcast: [The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)](https://stenobird.com/podcast/twiml-ai-podcast)
Published: 2024-07-09T14:00:00+00:00
Episode link: https://twimlai.com/podcast/twimlai/decoding-animal-behavior-to-train-robots-with-egopet/
Audio file: https://pscrb.fm/rss/p/traffic.megaphone.fm/MLN3784001197.mp3?updated=1720473918
Processing state: failed
JSON: https://stenobird.com/v1/public/podcasts/twiml-ai-podcast/episodes/decoding-animal-behavior-to-train-robots-with-egopet-with-amir-bar-692
Duration seconds: 2596

## Resource

Today, we're joined by Amir Bar, a PhD candidate at Tel Aviv University and UC Berkeley to discuss his research on visual-based learning, including his recent paper, “EgoPet: Egomotion and Interaction Data from an Animal’s Perspective.” Amir shares his research projects focused on self-supervised object detection and analogy reasoning for general computer vision tasks. We also discuss the current limitations of caption-based datasets in model training, the ‘learning problem’ in robotics, and the gap between the capabilities of animals and AI systems. Amir introduces ‘EgoPet,’ a dataset and benchmark tasks which allow motion and interaction data from an animal's perspective to be incorporated into machine learning models for robotic planning and proprioception. We explore the dataset collection process, comparisons with existing datasets and benchmark tasks, the findings on the model performance trained on EgoPet, and the potential of directly training robot policies that mimic animal behavior. The complete show notes for this episode can be found at https://twimlai.com/go/692.

## Actions

- request_transcript: `POST https://stenobird.com/v1/public/podcasts/twiml-ai-podcast/episodes/decoding-animal-behavior-to-train-robots-with-egopet-with-amir-bar-692/transcription-requests` — Idempotently request low-priority transcript generation for this episode.
- read_markdown: `GET https://stenobird.com/podcast/twiml-ai-podcast/decoding-animal-behavior-to-train-robots-with-egopet-with-amir-bar-692.md` — Read the agent-friendly Markdown representation of this episode resource.

A page view does not enqueue transcription. Agents should invoke `request_transcript` explicitly when they need this episode processed.

## Transcript

Full transcripts are not published on public pages unless there is a clear rights basis.