mirror of
https://github.com/scrapy/scrapy.git
synced 2025-02-23 18:23:51 +00:00
Merge branch 'protego-default' of github.com:whalebot-helmsman/scrapy into protego-default
This commit is contained in:
commit
50c85e3114
@ -1015,7 +1015,7 @@ If :attr:`Request.meta <scrapy.http.Request.meta>` has
|
||||
the request will be ignored by this middleware even if
|
||||
:setting:`ROBOTSTXT_OBEY` is enabled.
|
||||
|
||||
Parsers varies in several aspects:
|
||||
Parsers vary in several aspects:
|
||||
|
||||
* Language of implementation
|
||||
|
||||
|
Loading…
x
Reference in New Issue
Block a user