# Is one layer enough? Training a single transformer layer can match full-parameter RL training

Page: https://stenobird.com/podcast/best-ai-papers-explained-7258006/is-one-layer-enough-training-a-single-transformer-layer-can-match-full-parameter-rl-training
Text version: https://stenobird.com/podcast/best-ai-papers-explained-7258006/is-one-layer-enough-training-a-single-transformer-layer-can-match-full-parameter-rl-training.md
Podcast: [Best AI papers explained](https://stenobird.com/podcast/best-ai-papers-explained-7258006)
Published: 2026-07-04T18:08:30+00:00
Episode link: https://podcasters.spotify.com/pod/show/ehwkang/episodes/Is-one-layer-enough--Training-a-single-transformer-layer-can-match-full-parameter-RL-training-e3llfe8
Audio file: https://anchor.fm/s/1026675f8/podcast/play/122387336/https%3A%2F%2Fd3ctxlq1ktw2nl.cloudfront.net%2Fstaging%2F2026-6-4%2F05f35a5b-43aa-0340-6cfc-efa9d013a905.m4a
Processing state: not_requested
JSON: https://stenobird.com/v1/public/podcasts/best-ai-papers-explained-7258006/episodes/is-one-layer-enough-training-a-single-transformer-layer-can-match-full-parameter-rl-training
Duration seconds: 1385

## Resource

This paper explores a surprising structural property of large language models: most reinforcement learning (RL) gains are concentrated in a very small subset of transformer layers. By isolating and training individual layers, researchers discovered that optimizing just a single middle layer can match or even exceed the performance of full-parameter RL training. This phenomenon was remarkably consistent across multiple model families like Qwen3 and Qwen2.5, various RL algorithms, and diverse tasks including mathematics, coding, and agentic decision-making. The study reveals that layers near the input and output ends contribute significantly less to post-training improvements than those in the 40%–60% depth range. Leveraging these insights, the authors developed layer-aware training strategies that prioritize these high-contribution layers to outperform standard uniform training methods. Additionally, the findings suggest that different layers capture complementary problem-solving behaviors, which can be combined through majority voting for further accuracy gains. Overall, the work challenges the assumption that RL adaptation must be distributed throughout a network and offers a more efficient, targeted approach to LLM post-training.

## Actions

- request_transcript: `POST https://stenobird.com/v1/public/podcasts/best-ai-papers-explained-7258006/episodes/is-one-layer-enough-training-a-single-transformer-layer-can-match-full-parameter-rl-training/transcription-requests` — Idempotently request low-priority transcript generation for this episode.
- read_markdown: `GET https://stenobird.com/podcast/best-ai-papers-explained-7258006/is-one-layer-enough-training-a-single-transformer-layer-can-match-full-parameter-rl-training.md` — Read the agent-friendly Markdown representation of this episode resource.

A page view does not enqueue transcription. Agents should invoke `request_transcript` explicitly when they need this episode processed.

## Transcript

Full transcripts are not published on public pages unless there is a clear rights basis.