# Embryology of AI: How Training Data Shapes AI Development w/ Timaeus' Jesse Hoogland & Daniel Murfet

Page: https://stenobird.com/podcast/the-cognitive-revolution/embryology-of-ai-how-training-data-shapes-ai-development-w-timaeus-jesse-hoogland-daniel-murfet
Text version: https://stenobird.com/podcast/the-cognitive-revolution/embryology-of-ai-how-training-data-shapes-ai-development-w-timaeus-jesse-hoogland-daniel-murfet.md
Podcast: ["The Cognitive Revolution" | AI Builders, Researchers, and Live Player Analysis](https://stenobird.com/podcast/the-cognitive-revolution)
Published: 2025-06-19T13:33:00+00:00
Episode link: https://www.cognitiverevolution.ai
Audio file: https://pdst.fm/e/mgln.ai/e/1113/pscrb.fm/rss/p/traffic.megaphone.fm/RINTP3129166146.mp3?updated=1751620827
Processing state: processed
JSON: https://stenobird.com/v1/public/podcasts/the-cognitive-revolution/episodes/embryology-of-ai-how-training-data-shapes-ai-development-w-timaeus-jesse-hoogland-daniel-murfet
Duration seconds: 5814

## Resource

Jesse Hoogland and Daniel Murfet, founders of Timaeus, introduce their mathematically rigorous approach to AI safety through "developmental interpretability" based on Singular Learning Theory. They explain how neural network loss landscapes are actually complex, jagged surfaces full of "singularities" where models can change internally without affecting external behavior—potentially masking dangerous misalignment. Using their Local Learning Coefficient measure, they've demonstrated the ability to identify critical phase changes during training in models up to 7 billion parameters, offering a complementary approach to mechanistic interpretability. This work aims to move beyond trial-and-error neural network training toward a more principled engineering discipline that could catch safety issues during training rather than after deployment. Sponsors: Oracle Cloud Infrastructure: Oracle Cloud Infrastructure (OCI) is the next-generation cloud that delivers better performance, faster speeds, and significantly lower costs, including up to 50% less for compute, 70% for storage, and 80% for networking. Run any workload, from infrastructure to AI, in a high-availability environment and try OCI for free with zero commitment at https://oracle.com/cognitive The AGNTCY: The AGNTCY is an open-source collective dedicated to building the Internet of Agents, enabling AI agents to communicate and collaborate seamlessly across frameworks. Join a community of engineers focused on high-quality multi-agent software and support the initiative at ⁠https://agntcy.org NetSuite by Oracle: NetSuite by Oracle is the AI-powered business management suite trusted by over 41,000 businesses, offering a unified platform for accounting, financial management, inventory, and HR. Gain total visibility and co…

## Actions

- request_transcript: `POST https://stenobird.com/v1/public/podcasts/the-cognitive-revolution/episodes/embryology-of-ai-how-training-data-shapes-ai-development-w-timaeus-jesse-hoogland-daniel-murfet/transcription-requests` — Idempotently request low-priority transcript generation for this episode.
- read_markdown: `GET https://stenobird.com/podcast/the-cognitive-revolution/embryology-of-ai-how-training-data-shapes-ai-development-w-timaeus-jesse-hoogland-daniel-murfet.md` — Read the agent-friendly Markdown representation of this episode resource.

A page view does not enqueue transcription. Agents should invoke `request_transcript` explicitly when they need this episode processed.

## Transcript

Full transcripts are not published on public pages unless there is a clear rights basis.