Episode
Mastering Reasoning LLMs: Decoding AI's Complex Problem-Solving Strategies
- Published
- Jul 29, 2025
- Duration seconds
- 2023
- Processing state
not_requested
Actions
POST https://stenobird.com/v1/public/podcasts/smart-enterprises-ai-frontiers-7077810/episodes/mastering-reasoning-llms-decoding-ai-s-complex-problem-solving-strategies/transcription-requests
Idempotently request low-priority transcript generation for this episode.GET https://stenobird.com/podcast/smart-enterprises-ai-frontiers-7077810/mastering-reasoning-llms-decoding-ai-s-complex-problem-solving-strategies.md
Read the agent-friendly Markdown representation of this episode resource.
Summary
Join us for an insightful exploration into the world of Reasoning LLMs , drawing on the expertise of Sebastian Raschka, PhD. This episode demystifies how Large Language Models (LLMs) are being refined to excel at complex tasks that require intermediate steps , such as solving puzzles, advanced mathematics, and challenging coding problems, moving beyond simple factual question-answering. We'll uncover the four main approaches currently used to build and improve these specialised reasoning capabilities : Inference-time scaling : Discover how techniques like Chain-of-Thought (CoT) prompting encourage LLMs to generate intermediate reasoning steps, mimicking a 'thought process' and often leading to more accurate results on more complex problems. This approach increases computational resources during inference, making it more expensive. Pure Reinforcement Learning (RL) : Learn about the surprising emergence of reasoning behaviour from pure reinforcement learning, as demonstrated by DeepSeek-R1-Zero. This model was trained exclusively with RL, without an initial supervised fine-tuning (SFT) stage, using accuracy and format rewards to develop basic reasoning skills. Supervised Fine-tuning (SFT) + Reinforcement Learning (RL) : Understand this key approach for building high-performance reasoning models , exemplified by DeepSeek's flagship R1 model. This method refines models with additional SFT stages and further RL training, building upon "cold-started" pure RL models. Pure SFT and Distillation : Explore how smaller, more efficient reasoning models can be created by instruction fine-tuning them on high-quality SFT data generated by larger, stronger LLMs. This approach is particularly attractive for creating models that are cheaper to run and can operate on lower-end h…