# A 30B Model Crawled on My Mini PC, But the Weights Were Innocent

Page: https://stenobird.com/podcast/tech-stories-tech-brief-by-hackernoon-6365648/a-30b-model-crawled-on-my-mini-pc-but-the-weights-were-innocent
Text version: https://stenobird.com/podcast/tech-stories-tech-brief-by-hackernoon-6365648/a-30b-model-crawled-on-my-mini-pc-but-the-weights-were-innocent.md
Podcast: [Tech Stories Tech Brief By HackerNoon](https://stenobird.com/podcast/tech-stories-tech-brief-by-hackernoon-6365648)
Published: 2026-07-07T16:00:35+00:00
Episode link: https://share.transistor.fm/s/3379afb0
Audio file: https://media.transistor.fm/3379afb0/f82086d5.mp3
Processing state: not_requested
JSON: https://stenobird.com/v1/public/podcasts/tech-stories-tech-brief-by-hackernoon-6365648/episodes/a-30b-model-crawled-on-my-mini-pc-but-the-weights-were-innocent
Duration seconds: 399

## Resource

This story was originally published on HackerNoon at: https://hackernoon.com/a-30b-model-crawled-on-my-mini-pc-but-the-weights-were-innocent . GLM-4.7-Flash is a 30B model with 3B active params, so why did it crawl on my mini PC? Not the weights, not the quant. The attention design, and the runtime. Check more stories related to tech-stories at: https://hackernoon.com/c/tech-stories . You can also check exclusive content about #local-llms , #mixture-of-experts , #multi-head-latent-attention , #kv-cache , #llamacpp , #glm-4.7-flash-benchmark , #gguf-quantization-benchmark , #hackernoon-top-story , and more. This story was written by: @joshgreen-dev . Learn more about this writer by checking @joshgreen-dev's about page, and for more stories, please visit hackernoon.com . GLM-4.7-Flash should fly on a small box: 30B total, ~3B active. On a Radeon 780M mini PC it crawled and fell apart past short context. The cause was not the weights or the quant. It was Multi-head Latent Attention with no runtime that implemented it, so the model fell back to plain attention and the KV cache ballooned ~17x. Swapping to ik_llama.cpp with a real MLA path fixed it.

## Actions

- request_transcript: `POST https://stenobird.com/v1/public/podcasts/tech-stories-tech-brief-by-hackernoon-6365648/episodes/a-30b-model-crawled-on-my-mini-pc-but-the-weights-were-innocent/transcription-requests` — Idempotently request low-priority transcript generation for this episode.
- read_markdown: `GET https://stenobird.com/podcast/tech-stories-tech-brief-by-hackernoon-6365648/a-30b-model-crawled-on-my-mini-pc-but-the-weights-were-innocent.md` — Read the agent-friendly Markdown representation of this episode resource.

A page view does not enqueue transcription. Agents should invoke `request_transcript` explicitly when they need this episode processed.

## Transcript

Full transcripts are not published on public pages unless there is a clear rights basis.