# AI Engineering Pitfalls with Chip Huyen - #715 Page: https://stenobird.com/podcast/twiml-ai-podcast/ai-engineering-pitfalls-with-chip-huyen-715 Text version: https://stenobird.com/podcast/twiml-ai-podcast/ai-engineering-pitfalls-with-chip-huyen-715.md Podcast: [The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)](https://stenobird.com/podcast/twiml-ai-podcast) Published: 2025-01-21T22:26:00+00:00 Episode link: https://twimlai.com/podcast/twimlai/ai-engineering-pitfalls/ Audio file: https://pscrb.fm/rss/p/traffic.megaphone.fm/MLN3302347327.mp3?updated=1737498763 Processing state: failed JSON: https://stenobird.com/v1/public/podcasts/twiml-ai-podcast/episodes/ai-engineering-pitfalls-with-chip-huyen-715 Duration seconds: 3457 ## Resource Today, we're joined by Chip Huyen, independent researcher and writer to discuss her new book, “AI Engineering.” We dig into the definition of AI engineering, its key differences from traditional machine learning engineering, the common pitfalls encountered in engineering AI systems, and strategies to overcome them. We also explore how Chip defines AI agents, their current limitations and capabilities, and the critical role of effective planning and tool utilization in these systems. Additionally, Chip shares insights on the importance of evaluation in AI systems, highlighting the need for systematic processes, human oversight, and rigorous metrics and benchmarks. Finally, we touch on the impact of open-source models, the potential of synthetic data, and Chip’s predictions for the year ahead. The complete show notes for this episode can be found at https://twimlai.com/go/715. ## Actions - request_transcript: `POST https://stenobird.com/v1/public/podcasts/twiml-ai-podcast/episodes/ai-engineering-pitfalls-with-chip-huyen-715/transcription-requests` — Idempotently request low-priority transcript generation for this episode. - read_markdown: `GET https://stenobird.com/podcast/twiml-ai-podcast/ai-engineering-pitfalls-with-chip-huyen-715.md` — Read the agent-friendly Markdown representation of this episode resource. A page view does not enqueue transcription. Agents should invoke `request_transcript` explicitly when they need this episode processed. ## Transcript Full transcripts are not published on public pages unless there is a clear rights basis.