Scraping Dynamic Web Pages with Python 3 and Selenium
Go from saying hello to Selenium to combining it with Python and Beautiful Soup to extract information from a dynamic web page. Master WebDriver navigation, user activity recording, and more while creating a real estate web scraper in this course.
There are many ways to collect data, one of which is extracting the tons of data swimming around in the form of websites. However, gathering and analyzing data from dynamic websites can be frustrating, especially when essential information is only available after interacting with web elements. In this course, Scraping Dynamic Web Pages with Python 3 and Selenium, you’ll gain the ability to efficiently extract data from dynamically-rendered web pages. First, you’ll explore how to understand and navigate dynamic web pages using Selenium WebDriver, as well as how to record, replay, and customize user activity sessions to interact with web elements effectively. Next, you’ll discover how to manage wait times, locate elements, and navigate complex web pages with various types of selectors. Then, you’ll dive into parsing HTML using Beautiful Soup and applying best practices for web scraping. Finally, you’ll learn how to implement a real estate property scraper project, putting all the acquired skills into practice. When you’re finished with this course, you’ll have the skills and knowledge of web scraping with Python and Selenium needed to efficiently extract valuable data from dynamically-rendered web pages.
Author Name: Pratheerth Padman
Author Description:
Pratheerth is a Data Scientist who has entered the field after an eclectic mix of educational and work experiences. He has a Bachelor’s in Engineering in Mechatronics from India, Masters in Engineering Management from Australia and then a couple of years of work experience as a Production Engineer in the Middle East. Then when the A.I bug bit him, he dropped everything to dedicate his life to the field. He is currently working on mentoring, course creation and freelancing as a Data Scientist.
Table of Contents
- Course Overview
2mins - Mastering Dynamic Web Navigation
26mins - Automating and Customizing User Interactions
22mins - Locating, Navigating, and Engaging Web Elements
25mins - Unleashing the Power of HTML Parsing and Scraping
25mins
There are no reviews yet.