Webscraping

Overview:

List of Webscrapers

• BeautifulSoup

• Selenium

• Scrapy

BeautifulSoup

Used for small projects or quick tests

Selenium:

Clear choice for webscraper projects that will interact with webtesting or scraping pages that use JS to load content

Webtesting framework that can be used as a webscraper

Scrapy

Lagre amount of webscraping or handle large amount of data the choice is Scrapy Fast & Efficient, Portable, requires no dependencies but not userfriendly