# "How concerned should we be about OpenAI’s recurrent architecture rumors?" by Rauno Arike

Page: https://stenobird.com/podcast/lesswrong-curated-popular-5643401/how-concerned-should-we-be-about-openai-s-recurrent-architecture-rumors-by-rauno-arike
Text version: https://stenobird.com/podcast/lesswrong-curated-popular-5643401/how-concerned-should-we-be-about-openai-s-recurrent-architecture-rumors-by-rauno-arike.md
Podcast: [LessWrong (Curated & Popular)](https://stenobird.com/podcast/lesswrong-curated-popular-5643401)
Published: 2026-09-03T22:30:21+00:00
Episode link: https://www.buzzsprout.com/2037297/episodes/19752055-how-concerned-should-we-be-about-openai-s-recurrent-architecture-rumors-by-rauno-arike.mp3
Audio file: https://www.buzzsprout.com/2037297/episodes/19752055-how-concerned-should-we-be-about-openai-s-recurrent-architecture-rumors-by-rauno-arike.mp3
Processing state: not_requested
JSON: https://stenobird.com/v1/public/podcasts/lesswrong-curated-popular-5643401/episodes/how-concerned-should-we-be-about-openai-s-recurrent-architecture-rumors-by-rauno-arike
Duration seconds: 1131

## Resource

Yesterday, The Information reported that OpenAI's upcoming model, Astra, is built with a looped transformer architecture. Given that Zvi sounds (understandably) tired and this topic is somewhat in my wheelhouse, I'll try to spare him this one and provide a Zvi-style overview of what we know about the situation. I'll cover Astra's likely architecture and the case for and against concern. I'll also discuss how neuralese concerns should change with increases in hidden serial depth. What archi...

## Actions

- request_transcript: `POST https://stenobird.com/v1/public/podcasts/lesswrong-curated-popular-5643401/episodes/how-concerned-should-we-be-about-openai-s-recurrent-architecture-rumors-by-rauno-arike/transcription-requests` — Idempotently request low-priority transcript generation for this episode.
- read_markdown: `GET https://stenobird.com/podcast/lesswrong-curated-popular-5643401/how-concerned-should-we-be-about-openai-s-recurrent-architecture-rumors-by-rauno-arike.md` — Read the agent-friendly Markdown representation of this episode resource.

A page view does not enqueue transcription. Agents should invoke `request_transcript` explicitly when they need this episode processed.

## Transcript

Full transcripts are not published on public pages unless there is a clear rights basis.