Episode
The State of AI Engineering: What a Thousand Companies' Telemetry Reveals
- Published
- Jun 24, 2026
- Duration seconds
- 1166
- Processing state
not_requested- Canonical source
- https://digitalstrategy-ai.com/
Actions
POST https://stenobird.com/v1/public/podcasts/the-ai-tech-society-by-danar-6741953/episodes/the-state-of-ai-engineering-what-a-thousand-companies-telemetry-reveals/transcription-requests
Idempotently request low-priority transcript generation for this episode.GET https://stenobird.com/podcast/the-ai-tech-society-by-danar-6741953/the-state-of-ai-engineering-what-a-thousand-companies-telemetry-reveals.md
Read the agent-friendly Markdown representation of this episode resource.
Summary
Five Moves for Leaders Adopt a model gateway — centralize routing, failover, governance Build deprecation discipline — retire models deliberately Instrument agents deeply — especially with frameworks Audit prompt caching — fix layout (stable first, dynamic later) Implement budgets & backpressure — cap loops, build queues Seven Key Takeaways Multi-model is the norm (70%+ use 3+ models); use a gateway LLM tech debt compounds; retire old models deliberately Framework adoption doubled; observability burden doubled too 69% of tokens are system prompts; only 28% use caching Context windows exploded but quality beats volume Rate limits are the #1 failure mode Agents are still mostly monoliths; distributed shift is coming Key Quotes "The gap between a good demo and a dependable system is closed by effective evaluation and operational discipline." — Datadog "The next wave of agent failures won't be about what agents can't do. It'll be about what teams can't observe." — Guillermo Rauch, CEO, Vercel "Context quality, not volume, is the new limiting factor for LLM agents." Hosted on Acast. See acast.com/privacy for more information.