# When Metrics Become Comfort Blankies

Page: https://stenobird.com/podcast/the-kirkpatrick-podcast-6715780/when-metrics-become-comfort-blankies
Text version: https://stenobird.com/podcast/the-kirkpatrick-podcast-6715780/when-metrics-become-comfort-blankies.md
Podcast: [The Kirkpatrick Podcast](https://stenobird.com/podcast/the-kirkpatrick-podcast-6715780)
Published: 2026-01-12T13:38:00+00:00
Episode link: https://3ea3a25f-1173-44c4-a606-63622b7a81b3.libsyn.com/when-metrics-become-comfort-blankies
Audio file: https://traffic.libsyn.com/secure/3ea3a25f-1173-44c4-a606-63622b7a81b3/TKP_25-12-30_3.mp3?dest-id=4217883
Processing state: not_requested
JSON: https://stenobird.com/v1/public/podcasts/the-kirkpatrick-podcast-6715780/episodes/when-metrics-become-comfort-blankies
Duration seconds: 1507

## Resource

Most organizations can tell you exactly how many people attended training, how many completed it, and how satisfied they felt afterward. What they can't tell you—at least not with confidence—is whether any of it actually changed performance. And that's not a data problem. It's a leadership problem. In this episode, I challenge one of the most deeply embedded habits in learning and development: measuring what's convenient instead of what's useful. Attendance, completions, and engagement metrics feel objective. They're easy to collect, easy to defend, and easy to explain in a single slide. Over time, they've become the default—not because they answer meaningful business questions, but because they make us feel safe. The danger isn't that we measure activity. It's that we stop there. Activity metrics tell us what happened, not whether it mattered. They can inform design decisions and identify friction in the learning experience—but they can't tell leaders whether people can perform under real conditions, whether work became easier or harder, or whether systems and policies are actually enabling success. When pressure increases—tight timelines, rising risk, slipping performance—leaders don't want reassurance. They want insight. They want to know where performance is breaking down and what to do next. And activity data simply isn't built to answer those questions. In this conversation, I unpack why our reliance on convenience metrics is eroding trust in evaluation—and how the Kirkpatrick Model was never meant to validate activity, but to guide better decisions. Takeaways: Stop reporting data that comforts you but confuses leaders Treat Level 1 and 2 data as design inputs—not proof of success Ask whether interventions made work easier or harder Use evaluation to test assumpt…

## Actions

- request_transcript: `POST https://stenobird.com/v1/public/podcasts/the-kirkpatrick-podcast-6715780/episodes/when-metrics-become-comfort-blankies/transcription-requests` — Idempotently request low-priority transcript generation for this episode.
- read_markdown: `GET https://stenobird.com/podcast/the-kirkpatrick-podcast-6715780/when-metrics-become-comfort-blankies.md` — Read the agent-friendly Markdown representation of this episode resource.

A page view does not enqueue transcription. Agents should invoke `request_transcript` explicitly when they need this episode processed.

## Transcript

Full transcripts are not published on public pages unless there is a clear rights basis.