# Scrapy

> Scrapy is a fast high-level web crawling and web scraping framework, used
> to crawl websites and extract structured data from their pages. It can be used
> for a wide range of purposes, from data mining to monitoring and automated
> testing.

## Docs

- [Scrapy  documentation](https://Scrapy.readthedocs.io/en/latest/_sources/index.rst.txt)
- [Scrapy at a glance](https://Scrapy.readthedocs.io/en/latest/_sources/intro/overview.rst.txt)
- [Examples](https://Scrapy.readthedocs.io/en/latest/_sources/intro/examples.rst.txt)
- [Installation guide](https://Scrapy.readthedocs.io/en/latest/_sources/intro/install.rst.txt)
- [Scrapy Tutorial](https://Scrapy.readthedocs.io/en/latest/_sources/intro/tutorial.rst.txt)
- [Command line tool](https://Scrapy.readthedocs.io/en/latest/_sources/topics/commands.rst.txt)
- [Add-ons](https://Scrapy.readthedocs.io/en/latest/_sources/topics/addons.rst.txt)
- [Core API](https://Scrapy.readthedocs.io/en/latest/_sources/topics/api.rst.txt)
- [Architecture overview](https://Scrapy.readthedocs.io/en/latest/_sources/topics/architecture.rst.txt)
- [asyncio](https://Scrapy.readthedocs.io/en/latest/_sources/topics/asyncio.rst.txt)
- [AutoThrottle extension](https://Scrapy.readthedocs.io/en/latest/_sources/topics/autothrottle.rst.txt)
- [Benchmarking](https://Scrapy.readthedocs.io/en/latest/_sources/topics/benchmarking.rst.txt)
- [Broad Crawls](https://Scrapy.readthedocs.io/en/latest/_sources/topics/broad-crawls.rst.txt)
- [Components](https://Scrapy.readthedocs.io/en/latest/_sources/topics/components.rst.txt)
- [Spiders Contracts](https://Scrapy.readthedocs.io/en/latest/_sources/topics/contracts.rst.txt)
- [Coroutines](https://Scrapy.readthedocs.io/en/latest/_sources/topics/coroutines.rst.txt)
- [Debugging Spiders](https://Scrapy.readthedocs.io/en/latest/_sources/topics/debug.rst.txt)
- [Deploying Spiders](https://Scrapy.readthedocs.io/en/latest/_sources/topics/deploy.rst.txt)
- [Using your browser’s Developer Tools for scraping](https://Scrapy.readthedocs.io/en/latest/_sources/topics/developer-tools.rst.txt)
- [DjangoItem](https://Scrapy.readthedocs.io/en/latest/_sources/topics/djangoitem.rst.txt)
- [Download handlers](https://Scrapy.readthedocs.io/en/latest/_sources/topics/download-handlers.rst.txt)
- [Downloader Middleware](https://Scrapy.readthedocs.io/en/latest/_sources/topics/downloader-middleware.rst.txt)
- [Selecting dynamically-loaded content](https://Scrapy.readthedocs.io/en/latest/_sources/topics/dynamic-content.rst.txt)
- [Exceptions](https://Scrapy.readthedocs.io/en/latest/_sources/topics/exceptions.rst.txt)
- [Item Exporters](https://Scrapy.readthedocs.io/en/latest/_sources/topics/exporters.rst.txt)
- [Extensions](https://Scrapy.readthedocs.io/en/latest/_sources/topics/extensions.rst.txt)
- [Feed exports](https://Scrapy.readthedocs.io/en/latest/_sources/topics/feed-exports.rst.txt)
- [Item Pipeline](https://Scrapy.readthedocs.io/en/latest/_sources/topics/item-pipeline.rst.txt)
- [Items](https://Scrapy.readthedocs.io/en/latest/_sources/topics/items.rst.txt)
- [Jobs: pausing and resuming crawls](https://Scrapy.readthedocs.io/en/latest/_sources/topics/jobs.rst.txt)
- [Debugging memory leaks](https://Scrapy.readthedocs.io/en/latest/_sources/topics/leaks.rst.txt)
- [Link Extractors](https://Scrapy.readthedocs.io/en/latest/_sources/topics/link-extractors.rst.txt)
- [Item Loaders](https://Scrapy.readthedocs.io/en/latest/_sources/topics/loaders.rst.txt)
- [Logging](https://Scrapy.readthedocs.io/en/latest/_sources/topics/logging.rst.txt)
- [Downloading and processing files and images](https://Scrapy.readthedocs.io/en/latest/_sources/topics/media-pipeline.rst.txt)
- [Common Practices](https://Scrapy.readthedocs.io/en/latest/_sources/topics/practices.rst.txt)
- [Requests and Responses](https://Scrapy.readthedocs.io/en/latest/_sources/topics/request-response.rst.txt)
- [Scheduler](https://Scrapy.readthedocs.io/en/latest/_sources/topics/scheduler.rst.txt)
- [Scrapyd](https://Scrapy.readthedocs.io/en/latest/_sources/topics/scrapyd.rst.txt)
- [Selectors](https://Scrapy.readthedocs.io/en/latest/_sources/topics/selectors.rst.txt)
- [Settings](https://Scrapy.readthedocs.io/en/latest/_sources/topics/settings.rst.txt)
- [Scrapy shell](https://Scrapy.readthedocs.io/en/latest/_sources/topics/shell.rst.txt)
- [Signals](https://Scrapy.readthedocs.io/en/latest/_sources/topics/signals.rst.txt)
- [Spider Middleware](https://Scrapy.readthedocs.io/en/latest/_sources/topics/spider-middleware.rst.txt)
- [Spiders](https://Scrapy.readthedocs.io/en/latest/_sources/topics/spiders.rst.txt)
- [Stats Collection](https://Scrapy.readthedocs.io/en/latest/_sources/topics/stats.rst.txt)
- [Telnet Console](https://Scrapy.readthedocs.io/en/latest/_sources/topics/telnetconsole.rst.txt)
- [Frequently Asked Questions](https://Scrapy.readthedocs.io/en/latest/_sources/faq.rst.txt)
- [Release notes](https://Scrapy.readthedocs.io/en/latest/_sources/news.rst.txt)
- [Contributing to Scrapy](https://Scrapy.readthedocs.io/en/latest/_sources/contributing.rst.txt)
- [Versioning and API stability](https://Scrapy.readthedocs.io/en/latest/_sources/versioning.rst.txt)
- [Scrapy documentation quick start guide](https://Scrapy.readthedocs.io/en/latest/_sources/README.rst.txt)
