{"podcast":{"title":"The Data Exchange with Ben Lorica","slug":"the-data-exchange-with-ben-lorica","podcast_index_feed_id":1196000,"rss_url":"https://rss.buzzsprout.com/682433.rss","website_url":"https://thedataexchange.media/","image_url":"https://storage.buzzsprout.com/ljk0yj7r22pi61grsmelnsoa9084?.jpg","author":"Ben Lorica","episode_count":345,"summary":"A series of informal conversations with thought leaders, researchers, practitioners, and writers on a wide range of topics in technology, science, and of course big data, data science, artificial intelligence, and related applications. Anchored by Ben Lorica (@BigData), the Data Exchange also features a roundup of the most important stories from the worlds of data, machine learning and AI. Detailed show notes for each episode can be found on https://thedataexchange.media/ The Data Exchange podcast is a production of Gradient Flow [https://gradientflow.com/].","last_synced_at":null,"page_url":"https://stenobird.com/podcast/the-data-exchange-with-ben-lorica"},"episode":{"title":"World Models Are Here—But It’s Still the GPT-2 Phase","slug":"world-models-are-here-but-it-s-still-the-gpt-2-phase","published_at":"2026-03-19T11:00:00+00:00","page_url":"https://stenobird.com/podcast/the-data-exchange-with-ben-lorica/world-models-are-here-but-it-s-still-the-gpt-2-phase","show_page_url":"https://stenobird.com/podcast/the-data-exchange-with-ben-lorica","url":"https://dts.podtrac.com/redirect.mp3/www.buzzsprout.com/682433/episodes/18830049-world-models-are-here-but-it-s-still-the-gpt-2-phase.mp3","audio_url":"https://dts.podtrac.com/redirect.mp3/www.buzzsprout.com/682433/episodes/18830049-world-models-are-here-but-it-s-still-the-gpt-2-phase.mp3","summary":"World models represent a new frontier in AI, moving beyond discrete video clips to continuous, interactive simulations of potential futures. This discussion explores how these models function as a bridge between LLMs and generative video, predicting evolving environments through intelligent pixels.","meta_description":"Explore the frontier of world models: continuous, interactive AI simulations that predict potential futures, discussed with Odyssey CTO Jeff Hawke.","key_points":["Main idea: World models differ from generative video by providing a continuous, interactive stream of pixels rather than bounded clips","Practical takeaway: Early use cases include interactive weather visualizations and generative scaffolding for new types of computer gaming","Failure mode: Current state-of-the-art is limited to roughly one to two minutes of contiguous prediction before stability issues arise","Technical insight: The scaling trajectory for world models may be faster than LLMs due to existing advancements in GPU infrastructure and inference engines","Infrastructure note: Training these models relies on heavy-duty orchestration using PyTorch, Ray, and Kubernetes to manage massive video datasets"],"chapters":[{"start_ms":60000,"title":"Defining World Models","summary":"An introduction to the concept of continuous, interactive AI simulations that predict potential futures."},{"start_ms":260000,"title":"Early Use Cases","summary":"Exploring how developers are currently using world models for interactive applications and gaming."},{"start_ms":470000,"title":"The GPT-2 Era","summary":"Comparing the current state of world models to the early, prompt-sensitive days of large language models."},{"start_ms":660000,"title":"Prediction Limits","summary":"Discussing the current constraints on contiguous prediction duration and temporal stability."},{"start_ms":1060000,"title":"Data and Input Modalities","summary":"Evaluating the utility of different data types, such as LIDAR, for training world models."},{"start_ms":1260000,"title":"Developer Accessibility","summary":"The role of APIs and hackathons in driving the ecosystem for the next generation of models."},{"start_ms":1650000,"title":"Scaling and Gradients","summary":"The technical challenges of memory and backpropagating gradients through complex simulations."}],"topics":["World Models","Generative AI","Odyssey","Machine Learning Infrastructure","Predictive Simulation","Computer Vision","AI Scaling Laws","Neural Networks"],"duration_seconds":2666,"processing_state":"processed","actions":[{"name":"request_transcript","method":"POST","url":"https://stenobird.com/v1/public/podcasts/the-data-exchange-with-ben-lorica/episodes/world-models-are-here-but-it-s-still-the-gpt-2-phase/transcription-requests","description":"Idempotently request low-priority transcript generation for this episode."},{"name":"read_markdown","method":"GET","url":"https://stenobird.com/podcast/the-data-exchange-with-ben-lorica/world-models-are-here-but-it-s-still-the-gpt-2-phase.md","description":"Read the agent-friendly Markdown representation of this episode resource."}]}}