{"podcast":{"title":"CyberCode Academy","slug":"cybercode-academy-7578615","podcast_index_feed_id":7578615,"rss_url":"https://www.spreaker.com/show/6790974/episodes/feed","website_url":"https://www.spreaker.com/podcast/cybercode-academy--6790974","image_url":"https://d3wo5wojvuv7l.cloudfront.net/t_rss_itunes_square_1400/images.spreaker.com/original/5f51ccc7b22fdba95149ffa6346f1533.jpg","author":"CyberCode Academy","episode_count":311,"summary":"Welcome to CyberCode Academy — your audio classroom for Programming and Cybersecurity. 🎧 Each course is divided into a series of short, focused episodes that take you from beginner to advanced level — one lesson at a time. From Python and web development to ethical hacking and digital defense, our content transforms complex concepts into simple, engaging audio learning. Study anywhere, anytime — and level up your skills with CyberCode Academy. 🚀 Learn. Code. Secure. You can listen and download our episodes for free on more than 10 different platforms: https://linktr.ee/cybercode_academy","last_synced_at":"2026-07-27T12:18:25.188608+00:00","page_url":"https://stenobird.com/podcast/cybercode-academy-7578615"},"episode":{"title":"Course 40 - Web Scraping with Python | Episode 16: Mastering Data Extraction with Beautiful Soup","slug":"course-40-web-scraping-with-python-episode-16-mastering-data-extraction-with-beautiful-soup","published_at":"2026-07-26T06:00:02+00:00","page_url":"https://stenobird.com/podcast/cybercode-academy-7578615/course-40-web-scraping-with-python-episode-16-mastering-data-extraction-with-beautiful-soup","show_page_url":"https://stenobird.com/podcast/cybercode-academy-7578615","url":"https://www.spreaker.com/episode/course-40-web-scraping-with-python-episode-16-mastering-data-extraction-with-beautiful-soup--72756884","audio_url":"https://dts.podtrac.com/redirect.mp3/api.spreaker.com/download/episode/72756884/scale_web_scraping_from_requests_to_selenium.mp3","summary":"In this lesson, you’ll learn about: how web scraping works end-to-end, why fetching and parsing are the two core stages, and how different tools like Regex, BeautifulSoup, and Scrapy compare in real-world data extraction1. What is Web Scraping?🔹 Core IdeaWeb scraping = automated data extraction from websitesInstead of manually copying data, a program: Visits a page Reads the HTML Extracts structured information 2. Two-Phase Scraping Workflow🔹 Overall PipelinePhase 1: Fetching Content Send HTTP request (GET) Receive HTML response Store raw page content Tools: Requests urllib httplib2 Phase 2: Parsing & Extraction Analyze HTML structure Extract required data Clean results 3. Regex vs Structured Parsers🔹 Regular ExpressionsRegex: Works on text patterns Fast but fragile Breaks easily on messy HTML 👉 Key Insight HTML is not flat text—it’s structured data4. BeautifulSoup (Structure-Aware Parsing)🔹 Why It Works BetterBeautifulSoup: Understands HTML tree structure Fixes broken markup Lets you navigate elements easily 🔹 Key AdvantageInstead of guessing text patterns:👉 you navigate the DOM like a tree5. HTML vs DOM ParsingTypeDescriptionHTML parsingRaw server outputDOM parsingRendered browser structure🔹 Important Difference HTML = static snapshot DOM = live, updated by JavaScript 6. Static vs Dynamic Content🔹 Static Pages Easy to scrape No JavaScript required BeautifulSoup works well 🔹 Dynamic Pages Content generated by JavaScript Requires browser rendering Tools: Selenium Scrapy Headless browsers 👉 Key Insight If data appears after page load → you need a browser engine7. Advanced Tools Overview🔹 Scrapy (Industrial Tool) Built for scale Handles crawling + pipelines Used for production systems 🔹 Selenium Controls real browser Handles JavaScript Slower but powerful 🔹 Computer…","meta_description":"In this lesson, you’ll learn about: how web scraping works end-to-end, why fetching and parsing are the two core stages, and how different tools like Rege…","key_points":[],"chapters":[],"topics":[],"duration_seconds":1151,"processing_state":"not_requested","actions":[{"name":"request_transcript","method":"POST","url":"https://stenobird.com/v1/public/podcasts/cybercode-academy-7578615/episodes/course-40-web-scraping-with-python-episode-16-mastering-data-extraction-with-beautiful-soup/transcription-requests","description":"Idempotently request low-priority transcript generation for this episode."},{"name":"read_markdown","method":"GET","url":"https://stenobird.com/podcast/cybercode-academy-7578615/course-40-web-scraping-with-python-episode-16-mastering-data-extraction-with-beautiful-soup.md","description":"Read the agent-friendly Markdown representation of this episode resource."}]}}