{"podcast":{"title":"MLOps.community","slug":"mlops-community","podcast_index_feed_id":28679,"rss_url":"https://anchor.fm/s/174cb1b8/podcast/rss","website_url":"https://mlops.community","image_url":"https://d3t3ozftmdmh3i.cloudfront.net/production/podcast_uploaded_nologo/3809022/3809022-1612190855115-e91f8b881173f.jpg","author":"Demetrios","episode_count":516,"summary":"Relaxed Conversations around getting AI into production, whatever shape that may come in (agentic, traditional ML, LLMs, Vibes, etc)","last_synced_at":null,"page_url":"https://stenobird.com/podcast/mlops-community"},"episode":{"title":"Context Engineering, Context Rot, & Agentic Search with the CEO of Chroma, Jeff Huber","slug":"context-engineering-context-rot-agentic-search-with-the-ceo-of-chroma-jeff-huber","published_at":"2025-11-21T17:52:10+00:00","page_url":"https://stenobird.com/podcast/mlops-community/context-engineering-context-rot-agentic-search-with-the-ceo-of-chroma-jeff-huber","show_page_url":"https://stenobird.com/podcast/mlops-community","url":"https://podcasters.spotify.com/pod/show/mlops/episodes/Context-Engineering--Context-Rot---Agentic-Search-with-the-CEO-of-Chroma--Jeff-Huber-e3b9mch","audio_url":"https://anchor.fm/s/174cb1b8/podcast/play/111515473/https%3A%2F%2Fd3ctxlq1ktw2nl.cloudfront.net%2Fstaging%2F2025-10-21%2F412916747-44100-2-0cb0f712b55f3.mp3","summary":"Jeff Huber is the CEO of ​ Chroma , working on context engineering and building reliable retrieval infrastructure for AI systems. Context Engineering, Context Rot, & Agentic Search with the CEO of Chroma, Jeff Huber // MLOps Podcast #348. Join the Community: https://go.mlops.community/YTJoinIn Get the newsletter: https://go.mlops.community/YTNewsletter // Abstract Jeff Huber drops some hard truths about “context rot” — the slow decay of AI memory that’s quietly breaking your favorite models. From retrieval chaos to the hidden limits of context windows, he and Demetrios Brinkmann unpack why most AI systems forget what matters and how Chroma is rethinking the entire retrieval stack. It’s a bold look at whether smarter AI means cleaner context — or just better ways to hide the mess. // Bio Jeff Huber is the CEO and cofounder of Chroma. Chroma has raised $20M from top investors in Silicon Valley and builds modern search infrastructure for AI. // Related Links Website: https://www.trychroma.com/ ~~~~~~~~ ✌️Connect With Us ✌️ ~~~~~~~ Catch all episodes, blogs, newsletters, and more: https://go.mlops.community/TYExplore Join our Slack community [ https://go.mlops.community/slack ] Follow us on X/Twitter [@mlopscommunity]( https://x.com/mlopscommunity ) or [LinkedIn]( https://go.mlops.community/linkedin )] Sign up for the next meetup: [ https://go.mlops.community/register ] MLOps Swag/Merch: [ https://shop.mlops.community/ ] Connect with Demetrios on LinkedIn: /dpbrinkm Connect with Jeff on LinkedIn: /jeffchuber/ Timestamps: [00:00] AI intelligence context clarity [00:37] Context rot explanation [03:02] Benchmarking context windows [05:09] Breaking down search eras [10:50] Agent task memory issues [17:21] Semantic search limitations [22:54] Context hygiene in AI [30:15] Ch…","meta_description":"Jeff Huber is the CEO of ​ Chroma , working on context engineering and building reliable retrieval infrastructure for AI systems. Context Engineering, Con…","key_points":[],"chapters":[],"topics":[],"duration_seconds":2695,"processing_state":"failed","actions":[{"name":"request_transcript","method":"POST","url":"https://stenobird.com/v1/public/podcasts/mlops-community/episodes/context-engineering-context-rot-agentic-search-with-the-ceo-of-chroma-jeff-huber/transcription-requests","description":"Idempotently request low-priority transcript generation for this episode."},{"name":"read_markdown","method":"GET","url":"https://stenobird.com/podcast/mlops-community/context-engineering-context-rot-agentic-search-with-the-ceo-of-chroma-jeff-huber.md","description":"Read the agent-friendly Markdown representation of this episode resource."}]}}