Episode
Next-Token Predictor Is An AI's Job, Not Its Species
- Podcast
- Astral Codex Ten Podcast
- Published
- Apr 2, 2026
- Duration seconds
- 974
- Processing state
not_requested
Actions
POST https://stenobird.com/v1/public/podcasts/astral-codex-ten-podcast-226483/episodes/next-token-predictor-is-an-ai-s-job-not-its-species/transcription-requests
Idempotently request low-priority transcript generation for this episode.GET https://stenobird.com/podcast/astral-codex-ten-podcast-226483/next-token-predictor-is-an-ai-s-job-not-its-species.md
Read the agent-friendly Markdown representation of this episode resource.
Summary
I. In The Argument, Kelsey Piper gives a good description of the ways that AIs are more than just "next-token predictors" or "stochastic parrots" - for example, they also use fine-tuning and RLHF. But commenters, while appreciating the subtleties she introduces, object that they're still just extra layers on top of a machine that basically runs on next-token prediction. I want to approach this from a different direction. I think overemphasizing next-token prediction is a confusion of levels. On the levels where AI is a next-token predictor, you are also a next-token (technically: next-sense-datum) predictor. On the levels where you're not a next-token predictor, AI isn't one either.