{"podcast":{"title":"CyberCode Academy","slug":"cybercode-academy-7578615","podcast_index_feed_id":7578615,"rss_url":"https://www.spreaker.com/show/6790974/episodes/feed","website_url":"https://www.spreaker.com/podcast/cybercode-academy--6790974","image_url":"https://d3wo5wojvuv7l.cloudfront.net/t_rss_itunes_square_1400/images.spreaker.com/original/5f51ccc7b22fdba95149ffa6346f1533.jpg","author":"CyberCode Academy","episode_count":311,"summary":"Welcome to CyberCode Academy — your audio classroom for Programming and Cybersecurity. 🎧 Each course is divided into a series of short, focused episodes that take you from beginner to advanced level — one lesson at a time. From Python and web development to ethical hacking and digital defense, our content transforms complex concepts into simple, engaging audio learning. Study anywhere, anytime — and level up your skills with CyberCode Academy. 🚀 Learn. Code. Secure. You can listen and download our episodes for free on more than 10 different platforms: https://linktr.ee/cybercode_academy","last_synced_at":"2026-07-27T12:18:25.188608+00:00","page_url":"https://stenobird.com/podcast/cybercode-academy-7578615"},"episode":{"title":"Course 40 - Web Scraping with Python | Episode 12: From Parsing Foundations to Scrapy Essentials","slug":"course-40-web-scraping-with-python-episode-12-from-parsing-foundations-to-scrapy-essentials","published_at":"2026-07-22T06:00:02+00:00","page_url":"https://stenobird.com/podcast/cybercode-academy-7578615/course-40-web-scraping-with-python-episode-12-from-parsing-foundations-to-scrapy-essentials","show_page_url":"https://stenobird.com/podcast/cybercode-academy-7578615","url":"https://www.spreaker.com/episode/course-40-web-scraping-with-python-episode-12-from-parsing-foundations-to-scrapy-essentials--72756853","audio_url":"https://dts.podtrac.com/redirect.mp3/api.spreaker.com/download/episode/72756853/scaling_industrial_web_crawling_with_scrapy.mp3","summary":"In this lesson, you’ll learn about: how Scrapy turns simple scraping into large-scale crawling systems, the difference between scraping and crawling, and how to use a framework-driven approach for industrial web data extraction1. From Parsing to Real-World Crawling🔹 HTML vs DOM Parsing🔹 Key DifferenceTypeWhat it seesHTML parsingRaw server responseDOM parsingFinal rendered page👉 Key Insight JavaScript can completely change what your scraper sees after load2. Scraping vs Crawling🔹 Two Levels of Data CollectionConceptScopeScrapingSpecific pages/dataCrawlingEntire websites🔹 Real-World Analogy Scraping → reading one article Crawling → reading the entire library 3. Why Scrapy Exists🔹 The Framework AdvantageScrapy is not just a tool—it is a framework.👉 It controls execution and calls your code🔹 Inversion of ControlInstead of:you controlling everythingScrapy:controls the flow and executes your logic4. Core Scrapy Concepts🔹 Spider System Defines what to crawl Defines how to parse data Sends requests automatically 🔹 Engine Flow Scheduler queues URLs Engine sends requests Spider processes responses Pipeline stores data 5. Getting Started Tools🔹 Installationpip install scrapy 🔹 Useful Commands scrapy bench → performance test scrapy fetch URL → download raw HTML scrapy view URL → see rendered page 👉 Key Insight These tools let you inspect how Scrapy “sees” the web6. Scrapy Shell (Prototyping Tool)🔹 Interactive TestingUse it to: Test selectors Debug parsing logic Inspect live responses 7. CSS vs XPath Selectors🔹 Two Ways to Target DataMethodStrengthCSSSimple & readableXPathPowerful & flexible🔹 Exampleresponse.css(\"div.title\").get() response.xpath(\"//div[@class='title']\").get() 👉 Key Insight XPath can navigate complex structures CSS cannot8. Performance Thinking🔹 Why Scrapy i…","meta_description":"In this lesson, you’ll learn about: how Scrapy turns simple scraping into large-scale crawling systems, the difference between scraping and crawling, and…","key_points":[],"chapters":[],"topics":[],"duration_seconds":1197,"processing_state":"not_requested","actions":[{"name":"request_transcript","method":"POST","url":"https://stenobird.com/v1/public/podcasts/cybercode-academy-7578615/episodes/course-40-web-scraping-with-python-episode-12-from-parsing-foundations-to-scrapy-essentials/transcription-requests","description":"Idempotently request low-priority transcript generation for this episode."},{"name":"read_markdown","method":"GET","url":"https://stenobird.com/podcast/cybercode-academy-7578615/course-40-web-scraping-with-python-episode-12-from-parsing-foundations-to-scrapy-essentials.md","description":"Read the agent-friendly Markdown representation of this episode resource."}]}}