> For the complete documentation index, see [llms.txt](https://docs.arkannis.net/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://docs.arkannis.net/programming/python/modules/webscraping.md).

# Webscraping

## Overview:

### List of Webscrapers

* BeautifulSoup
* Selenium
* Scrapy

### BeautifulSoup

Used for small projects or quick tests

### Selenium:

Clear choice for webscraper projects that will interact with webtesting or scraping pages that use JS to load content

Webtesting framework that can be used as a webscraper

### Scrapy

Lagre amount of webscraping or handle large amount of data the choice is Scrapy Fast & Efficient, Portable, requires no dependencies but not userfriendly