Episode

Software and hardware acceleration with Groq

Podcast
Practical AI
Published
Apr 2, 2025
Duration seconds
2604
Processing state
failed
Canonical source
https://share.transistor.fm/s/5e63c891
Audio
https://pscrb.fm/rss/p/dts.podtrac.com/redirect.mp3/media.transistor.fm/5e63c891/c3ddeda7.mp3
JSON
/v1/public/podcasts/practical-ai/episodes/software-and-hardware-acceleration-with-groq
Markdown
/podcast/practical-ai/software-and-hardware-acceleration-with-groq.md

Actions

  • POST https://stenobird.com/v1/public/podcasts/practical-ai/episodes/software-and-hardware-acceleration-with-groq/transcription-requests
    Idempotently request low-priority transcript generation for this episode.
  • GET https://stenobird.com/podcast/practical-ai/software-and-hardware-acceleration-with-groq.md
    Read the agent-friendly Markdown representation of this episode resource.

Summary

How do you enable AI acceleration (at both the hardware and software layers) that stays ahead of rapid industry shifts? In this episode, Dhananjay Singh from Groq dives into the evolving landscape of AI inference and acceleration. We explore how Groq optimizes the serving layer, adapts to industry shifts, and supports emerging model architectures. Featuring: Dhananjay Singh – LinkedIn , X Chris Benson – Website , GitHub , LinkedIn , X Daniel Whitenack – Website , GitHub , X Links: Groq Sponsors: Augment Code - Developer AI that uses deep understanding of your large codebase and how you build software to deliver personalized code suggestions and insights. Augment provides relevant, contextualized code right in your IDE or Slack. It transforms scattered knowledge into code or answers, eliminating time spent searching docs or interrupting teammates.