{"podcast":{"title":"You've Been a Bad Agent","slug":"you-ve-been-a-bad-agent-7334728","podcast_index_feed_id":7334728,"rss_url":"https://feeds.transistor.fm/bad-agent","website_url":null,"image_url":"https://img.transistorcdn.com/WR6SHMOqkG90n9iPDIbsXb6q0zPpZub3Y0ll4wC0WEg/rs:fill:0:0:1/w:1400/h:1400/q:60/mb:500000/aHR0cHM6Ly9pbWct/dXBsb2FkLXByb2R1/Y3Rpb24udHJhbnNp/c3Rvci5mbS84NGFl/MjgyMzY0ZWJmNjM3/N2M4NmE0M2FjNDk4/MTgyOC5wbmc.jpg","author":"Matt Carey","episode_count":27,"summary":"Wil and Matt discuss tech, startups, and building really cool things with AI. Sometimes joined by (actual expert) friends.","last_synced_at":null,"page_url":"https://stenobird.com/podcast/you-ve-been-a-bad-agent-7334728"},"episode":{"title":"AI Engineering is Dead? Hectic Stag Dos, Event FOMO or Not to Go and Agent Evals are HARRDDD","slug":"ai-engineering-is-dead-hectic-stag-dos-event-fomo-or-not-to-go-and-agent-evals-are-harrddd","published_at":"2025-06-05T12:57:10+00:00","page_url":"https://stenobird.com/podcast/you-ve-been-a-bad-agent-7334728/ai-engineering-is-dead-hectic-stag-dos-event-fomo-or-not-to-go-and-agent-evals-are-harrddd","show_page_url":"https://stenobird.com/podcast/you-ve-been-a-bad-agent-7334728","url":"https://share.transistor.fm/s/ed149948","audio_url":"https://media.transistor.fm/ed149948/956eb39a.mp3","summary":"A deep dive into the friction of modern engineering, from the difficulty of evaluating AI agents to the complexities of JavaScript build tools. The hosts also reflect on the psychological impact of consumer behavior and the challenges of tracing Python subprocesses.","meta_description":"Explore the challenges of AI agent evals, Python tracing with sitecustomize, and the complexities of modern JavaScript build pipelines.","key_points":["Main idea: Evaluating AI agents remains a significant technical hurdle due to the difficulty of creating reliable benchmarks","Practical takeaway: Use Python's 'sitecustomize' feature to implement deep tracing for subprocesses and middleware","Failure mode: Relying on strict rules and rigid workflows in AI tooling can be less effective than a 'tools, not rules' architecture","Technical insight: Integrating legacy JavaScript libraries with modern Vite plugins and Cloudflare workers often creates complex configuration conflicts","Observation: The shift toward 'models plus fetch' architectures simplifies agentic workflows by prioritizing tool access over rigid instruction sets"],"chapters":[{"start_ms":60000,"title":"Reflections on Las Vegas and Consumerism","summary":"A discussion on the overwhelming nature of Las Vegas and the contrast between high-value products and low-value slot machines."},{"start_ms":300000,"title":"Travels in Peru","summary":"Personal updates regarding high-altitude hiking in Peru and the physical toll of travel."},{"start_ms":540000,"title":"LLM Creativity and Naming","summary":"Comparing the ability of different models, like Claude Opus, to generate creative and coherent names."},{"start_ms":720000,"title":"The JavaScript Build Tooling Nightmare","summary":"The struggle of configuring JSON Path, Vite plugins, and Cloudflare workers in a monorepo environment."},{"start_ms":960000,"title":"Deep Research and Python Tracing","summary":"How AI-driven deep research uncovered the 'sitecustomize' feature to solve complex Python tracing challenges."},{"start_ms":1440000,"title":"Architecting AI Agents","summary":"Moving away from strict rule-based systems toward flexible, tool-augmented model architectures."},{"start_ms":2340000,"title":"The Difficulty of Agent Evaluations","summary":"The technical challenges of creating dynamic inputs and outputs for benchmarking AI performance."}],"topics":["AI Engineering","Python Tracing","JavaScript Build Tools","AI Agent Evaluation","Cloudflare Workers","Software Architecture","LLM Research","Developer Experience"],"duration_seconds":3012,"processing_state":"processed","actions":[{"name":"request_transcript","method":"POST","url":"https://stenobird.com/v1/public/podcasts/you-ve-been-a-bad-agent-7334728/episodes/ai-engineering-is-dead-hectic-stag-dos-event-fomo-or-not-to-go-and-agent-evals-are-harrddd/transcription-requests","description":"Idempotently request low-priority transcript generation for this episode."},{"name":"read_markdown","method":"GET","url":"https://stenobird.com/podcast/you-ve-been-a-bad-agent-7334728/ai-engineering-is-dead-hectic-stag-dos-event-fomo-or-not-to-go-and-agent-evals-are-harrddd.md","description":"Read the agent-friendly Markdown representation of this episode resource."}]}}