Web Scraping with Python: BeautifulSoup, Requests & Selenium
- 4.3
-
![]()
![]()
![]()
![]()
Brief Introduction
Web Scraping and Crawling with Python: Beautiful Soup, Requests & SeleniumDescription
Web Scraping (also termed Screen Scraping, Web Data Extraction, Web Harvesting, etc.) is a technique for extracting large amounts of data from websites and save the the extracted data to a local file or to a database.
In this course, you will learn how to perform web scraping using Python 3 and the Beautiful Soup, a free open-source library written in Python for parsing HTML.
We will use lxml, which is an extensive library for parsing XML and HTML documents very quickly; it can even handle messed up tags. We will also be using the Requests module instead of the already built-in urllib2 module due to improvements in speed and readability.
Finally, we will use Selenium alongside Beautiful Soup to crawl AJAX & JavaScript driven pages.
The course cover the following topics: accessing web pages programmatically; scraping web pages to extract the required data using Beautiful Soup to parse web pages; interacting with web pages to do different things with them programmatically; and using Selenium for web scraping and when we need it.
By the end of this course, you will be able to understand how websites and servers function, diverse data extraction techniques, and methods of handling and organizing data.
This Web Scraping course covers the following topics:
- Review of data structures (Lists, Dictionaries, Tuples, File Handling)
- How websites are hosted on servers
- Calls to the server (GET, POST methods)
- Review of HTML and CSS
- Requests Module and BeautifulSoup Module overview
- Parsing HTML using BeautifulSoup
- Filtering elements using BeautifulSoup and navigating the Parse Tree
- JavaScript and AJAX overview
- Selenium and the need for it
- Selecting elements using Selenium
- CSS selectors
- XPath selectors
- Navigating pages using Selenium
- Practical Projects
Requirements
- Requirements
- Some prior programming experience in Python (e.g. Data Structures and OOP) will help. The course includes a full Python refresher section.
- Complete beginners may wish to take a beginner Python course first, and then transition to this course afterwards.
- This course adopts a step-by-step approach and requires you to open a Python editor, download available *.py code files, and start applying the provided examples and exercises.
- Python 3: Codes of this course are tested on Python 3. It is up to you to adapt them if you want to run them in Python 2.
GoTrained Academy
4.3 Raiting
Scrapy: Powerful Web Scraping & Crawling with Python
- 4.4
-
![]()
![]()
![]()
![]()
![]()
Python Scrapy Tutorial - Learn how to scrape websites and build a powerful web crawler using Scrapy, Splash and Python Why this course?...
Master Python Programming: The Complete Python Bootcamp 2021
- 4.6
-
![]()
![]()
![]()
![]()
![]()
Python for Beginners, 100% Hands-on, Hundreds of Python Coding Challenges and Quizzes, Complete Python E-Book. Course Updates: Update: November 2020 - Updates to be 2021 ready...
Python for Everybody: Five Domain Specialization
- 4.4
-
![]()
![]()
![]()
![]()
![]()
Game Development, Data Visualization, Web Scraping, Security and Cryptography, and Hacking--all at one course! Welcome to Python Programming world: The most popular language skill to have in 2020....
Web Scraping in Python With BeautifulSoup and Selenium 2021
- 4.6
-
![]()
![]()
![]()
![]()
![]()
The most up to date and project based Web Scraping course in Python using BeautifulSoup and Selenium! It’s the original growth tool and one of their best-kept secrets...
