The web is a giant database and when there’s no API, you can still retrieve the data through web scraping. In this course, Exploring Web Scraping with Python, you will learn foundational knowledge of web scraping and how to use Python’s rich set of scraping capabilities. First, you will learn how to download and extract data with Requests and Beautiful Soup. Next, you will discover how to build a spider in about 20 lines of code with Scrapy. Finally, you will explore how to use a robotic browser to solve advanced web scraping challenges. When you are finished with this course, you will know “SQL for web scraping,” and have the skills and knowledge of content selectors and Python needed to start your own website scraping projects.
Author Name: Clarke Bishop
Author Description:
Clarke Bishop is a Cloud Architect and Data Engineer who loves solving tough problems. He’s worked in Manufacturing, Agriculture, Telecommunications, Construction, Insurance, Financial Services, Human Resources, Marketing, and Media. Skills include Big Data with Spark and Python, Cloud Architecture and Full Stack Web Application Development with JavaScript frameworks and HTML. Clarke has an MBA with a concentration in Finance, a Masters in Electrical Engineering, and a Bachelors in Electrical En… more

Table of Contents

• Course Overview
  1min
• Why Scrape the Web?
  7mins
• The Web Scraping Process
  9mins
• CSS Selectors and XPath
  18mins
• Is Web Scraping Legal? Is it Ethical?
  9mins
• Web Scraping Basics with Python
  14mins
• Building a Web Spider with Scrapy
  15mins
• Advanced Web Scraping with Selenium and Requests-html
  13mins
• Course Summary
  3mins