mirror of
https://github.com/scrapy/scrapy.git
synced 2025-02-23 09:24:04 +00:00
update documentation
This commit is contained in:
parent
db202487f0
commit
6bd88711f2
@ -951,7 +951,7 @@ LOGSTATS_INTERVAL
|
||||
|
||||
Default: ``60.0``
|
||||
|
||||
The interval (in seconds) between each logging printout of the stats
|
||||
The interval (in seconds) between each logging printout of the stats
|
||||
by :class:`~scrapy.extensions.logstats.LogStats`.
|
||||
|
||||
.. setting:: MEMDEBUG_ENABLED
|
||||
@ -1165,7 +1165,7 @@ If enabled, Scrapy will respect robots.txt policies. For more information see
|
||||
ROBOTSTXT_PARSER
|
||||
----------------
|
||||
|
||||
Default: ``'scrapy.robotstxt.PythonRobotParser'``
|
||||
Default: ``'scrapy.robotstxt.ProtegoRobotParser'``
|
||||
|
||||
The parser backend to use for parsing ``robots.txt`` files. For more information see
|
||||
:ref:`topics-dlmw-robots`.
|
||||
|
Loading…
x
Reference in New Issue
Block a user