1
0
mirror of https://github.com/scrapy/scrapy.git synced 2025-02-23 18:23:51 +00:00

Merge branch 'protego-default' of github.com:whalebot-helmsman/scrapy into protego-default

This commit is contained in:
Vostretsov Nikita 2019-09-16 14:24:31 +00:00
commit 50c85e3114

View File

@ -1015,7 +1015,7 @@ If :attr:`Request.meta <scrapy.http.Request.meta>` has
the request will be ignored by this middleware even if
:setting:`ROBOTSTXT_OBEY` is enabled.
Parsers varies in several aspects:
Parsers vary in several aspects:
* Language of implementation