Episode

72: Multimodal AI for Ray-Ban Meta glasses

Podcast
Meta Tech Podcast
Published
Feb 28, 2025
Duration seconds
2374
Processing state
not_requested
Canonical source
https://insidefacebookmobile.libsyn.com/72-multi-modal-ai-for-ray-ban-meta-glasses
Audio
https://traffic.libsyn.com/secure/insidefacebookmobile/mtp72_rc2.mp3?dest-id=697376
JSON
/v1/public/podcasts/meta-tech-podcast-525691/episodes/72-multimodal-ai-for-ray-ban-meta-glasses
Markdown
/podcast/meta-tech-podcast-525691/72-multimodal-ai-for-ray-ban-meta-glasses.md

Actions

  • POST https://stenobird.com/v1/public/podcasts/meta-tech-podcast-525691/episodes/72-multimodal-ai-for-ray-ban-meta-glasses/transcription-requests
    Idempotently request low-priority transcript generation for this episode.
  • GET https://stenobird.com/podcast/meta-tech-podcast-525691/72-multimodal-ai-for-ray-ban-meta-glasses.md
    Read the agent-friendly Markdown representation of this episode resource.

Summary

In this episode of the Meta Tech Podcast, host Pascal sits down with Shane, a research scientist at Meta, to explore the cutting-edge research behind Ray-Ban Meta glasses. Shane shares insights from his seven-year journey at Meta, where he focuses on computer vision and multimodal AI within the Wearables AI organization. Tune in to learn how Shane's team is pioneering foundational models for Ray-Ban Meta glasses, tackling unique challenges, and pushing the boundaries of AI-driven innovation. Discover how multimodal AI is transforming user experiences and get a glimpse into the future of wearable technology. Whether you're an engineer, a tech enthusiast, or simply curious about the latest advancements, there is something for everyone in this episode. Got feedback? Send it to us on Threads ( https://threads.net/@metatechpod ), Instagram ( https://instagram.com/metatechpod ) and don't forget to follow our host Pascal ( https://mastodon.social/@passy , https://threads.net/@passy_ ). Fancy working with us? Check out https://www.metacareers.com/ . Links AnyMAL: An Efficient and Scalable Any-Modality Augmented Language Model - https://arxiv.org/abs/2309.16058 Be My Eyes Programme: https://www.forbes.com/sites/stevenaquino/2024/10/11/inside-the-be-my-eyes-meta-collaboration-and-the-allure-to--impact-humanity/ Meta Open Source on Threads: https://www.threads.net/@metaopensource CacheLib: https://cachelib.org/ Meta's AI-Powered Ray-Bans Are Life-Enhancing for the Blind - Wall Street Journal: https://www.wsj.com/tech/ai/metas-ai-powered-ray-bans-are-life-enhancing-for-the-blind-3ae38026 Timestamps Intro 0:06 OSS News 0:56 Introduction Shane 1:30 The role of research scientist over time 3:03 What's Multimodal AI? 5:45 Applying Multimodal AI in Meta's products 7:21 Acoustic modalit…