{"podcast":{"title":"Training Data","slug":"training-data","podcast_index_feed_id":null,"rss_url":"https://feeds.megaphone.fm/trainingdata","website_url":"https://www.sequoiacap.com/","image_url":"https://megaphone.imgix.net/podcasts/8ca8a61c-08b4-11ef-97ab-9fe273d59030/image/4a16fd33b06708003827556209cd42b7.png?ixlib=rails-4.3.1&max-w=3000&max-h=3000&fit=crop&auto=format,compress","author":"Sequoia Capital","episode_count":104,"summary":"Join us as we train our neural nets on the theme of the century: AI. Sonya Huang, Pat Grady and more Sequoia Capital partners host conversations with leading AI builders and researchers to ask critical questions and develop a deeper understanding of the evolving technologies—and their implications for technology, business and society. The content of this podcast does not constitute investment advice, an offer to provide investment advisory services, or an offer to sell or solicitation of an offer to buy an interest in any investment fund.","last_synced_at":"2026-08-02T15:06:49.231983+00:00","page_url":"https://stenobird.com/podcast/training-data"},"episode":{"title":"Why Hardware-Software Co-Design Is AI's Real 100x: Dylan Patel of SemiAnalysis","slug":"why-hardware-software-co-design-is-ai-s-real-100x-dylan-patel-of-semianalysis","published_at":"2026-06-30T09:00:00+00:00","page_url":"https://stenobird.com/podcast/training-data/why-hardware-software-co-design-is-ai-s-real-100x-dylan-patel-of-semianalysis","show_page_url":"https://stenobird.com/podcast/training-data","url":"https://pscrb.fm/rss/p/traffic.megaphone.fm/CPUAI5467568199.mp3","audio_url":"https://pscrb.fm/rss/p/traffic.megaphone.fm/CPUAI5467568199.mp3","summary":"The massive performance gains in AI are driven by hardware-software co-design rather than raw silicon speed. By optimizing model architectures, kernels, and silicon simultaneously, developers can achieve 100x efficiency improvements.","meta_description":"Dylan Patel explains why hardware-software co-design is the real driver of AI progress and how NVIDIA uses 'neoclouds' to maintain a multipolar market.","key_points":["Main idea: True AI scaling comes from the synergy between model architecture, software kernels, and hardware topology","Practical takeaway: Model developers like OpenAI and Anthropic are choosing architectures (sparse vs. dense) that specifically favor certain hardware strengths","Failure mode: Relying solely on general-purpose GPUs without optimizing for specific network topologies or matrix multiply units limits potential gains","Market insight: The 'CUDA moat' is weakening as model labs become increasingly willing to write custom kernels for alternative hardware","Strategic insight: NVIDIA's support for 'neoclouds' is a deliberate move to prevent a monopoly by hyperscalers like Google and Amazon"],"chapters":[{"start_ms":60000,"title":"The Rise of SemiAnalysis","summary":"A look at the origins of SemiAnalysis and its unique position at the intersection of engineering and finance."},{"start_ms":1020000,"title":"InferenceX and Real-time Benchmarking","summary":"How running daily benchmarks on the latest global models provides a transparent view of the current AI landscape."},{"start_ms":1620000,"title":"The Power of Co-Design","summary":"Why the most significant AI breakthroughs occur when software and hardware layers are optimized in tandem."},{"start_ms":1920000,"title":"NVIDIA vs. TPU: The Architecture War","summary":"Comparing the trade-offs between NVIDIA's switched GPU networks and Google's high-bandwidth TPU topologies."},{"start_ms":2280000,"title":"The Erosion of the CUDA Moat","summary":"Analyzing why the software advantage of NVIDIA is facing new challenges from specialized model requirements."},{"start_ms":3180000,"title":"NVIDIA's Multipolar Strategy","summary":"How Jensen Huang uses neoclouds to ensure a competitive ecosystem that prevents hyperscaler dominance."},{"start_ms":3840000,"title":"The Future of the Compute Market","summary":"Reflections on the rapid growth of new compute players and the evolving landscape of AI infrastructure."}],"topics":["Semiconductors","AI Infrastructure","NVIDIA","TPU","Machine Learning Hardware","Cloud Computing","Deep Learning Optimization","Supply Chain"],"duration_seconds":4214,"processing_state":"processed","actions":[{"name":"request_transcript","method":"POST","url":"https://stenobird.com/v1/public/podcasts/training-data/episodes/why-hardware-software-co-design-is-ai-s-real-100x-dylan-patel-of-semianalysis/transcription-requests","description":"Idempotently request low-priority transcript generation for this episode."},{"name":"read_markdown","method":"GET","url":"https://stenobird.com/podcast/training-data/why-hardware-software-co-design-is-ai-s-real-100x-dylan-patel-of-semianalysis.md","description":"Read the agent-friendly Markdown representation of this episode resource."}]}}