Episode
Building AI Voice Agents with Scott Stephenson - #707
- Published
- Oct 28, 2024
- Duration seconds
- 3704
- Processing state
failed- Canonical source
- https://twimlai.com/podcast/twimlai/building-ai-voice-agents/
Actions
POST https://stenobird.com/v1/public/podcasts/twiml-ai-podcast/episodes/building-ai-voice-agents-with-scott-stephenson-707/transcription-requests
Idempotently request low-priority transcript generation for this episode.GET https://stenobird.com/podcast/twiml-ai-podcast/building-ai-voice-agents-with-scott-stephenson-707.md
Read the agent-friendly Markdown representation of this episode resource.
Summary
Today, we're joined by Scott Stephenson, co-founder and CEO of Deepgram to discuss voice AI agents. We explore the importance of perception, understanding, and interaction and how these key components work together in building intelligent AI voice agents. We discuss the role of multimodal LLMs as well as speech-to-text and text-to-speech models in building AI voice agents, and dig into the benefits and limitations of text-based approaches to voice interactions. We dig into what’s required to deliver real-time voice interactions and the promise of closed-loop, continuously improving, federated learning agents. Finally, Scott shares practical applications of AI voice agents at Deepgram and provides an overview of their newly released agent toolkit. The complete show notes for this episode can be found at https://twimlai.com/go/707.