{"podcast":{"title":"Tech Stories Tech Brief By HackerNoon","slug":"tech-stories-tech-brief-by-hackernoon-6365648","podcast_index_feed_id":6365648,"rss_url":"https://feeds.transistor.fm/tech-stories-tech-brief-by-hackernoon","website_url":"https://hackernoon.com/c/tech-stories","image_url":"https://img.transistorcdn.com/P-42oHG33sV1aPenbVg2DrwaV5AQtWp46GJ4Bp_EP-s/rs:fill:0:0:1/w:1400/h:1400/q:60/mb:500000/aHR0cHM6Ly9pbWct/dXBsb2FkLXByb2R1/Y3Rpb24udHJhbnNp/c3Rvci5mbS9zaG93/LzQxNDI5LzE2ODM1/ODM0NjQtYXJ0d29y/ay5qcGc.jpg","author":"HackerNoon","episode_count":100,"summary":"Learn the latest tech-stories updates in the tech world.","last_synced_at":"2026-07-30T06:17:37.489609+00:00","page_url":"https://stenobird.com/podcast/tech-stories-tech-brief-by-hackernoon-6365648"},"episode":{"title":"Why Local LLMs Suddenly Slow Down at Long Context","slug":"why-local-llms-suddenly-slow-down-at-long-context","published_at":"2026-06-28T16:00:56+00:00","page_url":"https://stenobird.com/podcast/tech-stories-tech-brief-by-hackernoon-6365648/why-local-llms-suddenly-slow-down-at-long-context","show_page_url":"https://stenobird.com/podcast/tech-stories-tech-brief-by-hackernoon-6365648","url":"https://share.transistor.fm/s/ecca952f","audio_url":"https://media.transistor.fm/ecca952f/01bdbf67.mp3","summary":"This story was originally published on HackerNoon at: https://hackernoon.com/why-local-llms-suddenly-slow-down-at-long-context . Your local LLM runs fine until it doesn't. A look at KV cache spilling from VRAM into shared memory, and why it happens silently on Windows. Check more stories related to tech-stories at: https://hackernoon.com/c/tech-stories . You can also check exclusive content about #local-llms , #llama.cpp , #kv-cache , #vram , #gpu , #local-inference , #machine-learning , #hackernoon-top-story , and more. This story was written by: @speederx . Learn more about this writer by checking @speederx's about page, and for more stories, please visit hackernoon.com . Your local LLM runs fine until the context fills up past a certain point - then generation speed can drop by ~50%. The cause is the KV cache spilling out of VRAM into slower shared memory. On Windows it happens silently, with no out-of-memory error to warn you.","meta_description":"This story was originally published on HackerNoon at: https://hackernoon.com/why-local-llms-suddenly-slow-down-at-long-context . Your local LLM runs fine…","key_points":[],"chapters":[],"topics":[],"duration_seconds":331,"processing_state":"not_requested","actions":[{"name":"request_transcript","method":"POST","url":"https://stenobird.com/v1/public/podcasts/tech-stories-tech-brief-by-hackernoon-6365648/episodes/why-local-llms-suddenly-slow-down-at-long-context/transcription-requests","description":"Idempotently request low-priority transcript generation for this episode."},{"name":"read_markdown","method":"GET","url":"https://stenobird.com/podcast/tech-stories-tech-brief-by-hackernoon-6365648/why-local-llms-suddenly-slow-down-at-long-context.md","description":"Read the agent-friendly Markdown representation of this episode resource."}]}}