mirror of
https://github.com/scrapy/scrapy.git
synced 2025-02-23 04:23:47 +00:00
3ac3ac4d92
This fixes the explanation to use Requests instead of URLs, which is what actually happens, and is also consistent with the new tutorial, which already explains how URLs become Request objects. I've also changed the "loop", jumping from 9 to step 2.
======
Scrapy
======
.. image:: https://img.shields.io/pypi/v/Scrapy.svg
:target: https://pypi.python.org/pypi/Scrapy
:alt: PyPI Version
.. image:: https://img.shields.io/travis/scrapy/scrapy/master.svg
:target: http://travis-ci.org/scrapy/scrapy
:alt: Build Status
.. image:: https://img.shields.io/badge/wheel-yes-brightgreen.svg
:target: https://pypi.python.org/pypi/Scrapy
:alt: Wheel Status
.. image:: http://static.scrapy.org/py3progress/badge.svg
:target: https://github.com/scrapy/scrapy/wiki/Python-3-Porting
:alt: Python 3 Porting Status
.. image:: https://img.shields.io/codecov/c/github/scrapy/scrapy/master.svg
:target: http://codecov.io/github/scrapy/scrapy?branch=master
:alt: Coverage report
Overview
========
Scrapy is a fast high-level web crawling and web scraping framework, used to
crawl websites and extract structured data from their pages. It can be used for
a wide range of purposes, from data mining to monitoring and automated testing.
For more information including a list of features check the Scrapy homepage at:
http://scrapy.org
Requirements
============
* Python 2.7 or Python 3.3+
* Works on Linux, Windows, Mac OSX, BSD
Install
=======
The quick way::
pip install scrapy
For more details see the install section in the documentation:
http://doc.scrapy.org/en/latest/intro/install.html
Releases
========
You can download the latest stable and development releases from:
http://scrapy.org/download/
Documentation
=============
Documentation is available online at http://doc.scrapy.org/ and in the ``docs``
directory.
Community (blog, twitter, mail list, IRC)
=========================================
See http://scrapy.org/community/
Contributing
============
Please note that this project is released with a Contributor Code of Conduct
(see https://github.com/scrapy/scrapy/blob/master/CODE_OF_CONDUCT.md).
By participating in this project you agree to abide by its terms.
Please report unacceptable behavior to opensource@scrapinghub.com.
See http://doc.scrapy.org/en/master/contributing.html
Companies using Scrapy
======================
See http://scrapy.org/companies/
Commercial Support
==================
See http://scrapy.org/support/