Pawel Miech
f98ffb53b6
add docs for some scheduler settings
2016-11-29 16:52:54 +01:00
Valdir Stumm Junior
d61650d843
fix RANDOMIZE_DOWNLOAD_DELAY description in the docs
2016-08-19 18:24:32 -03:00
Elias Dorneles
34e7dadf38
Merge pull request #1610 from darshanime/scheduler_debug
...
[MGR+1] Change, document `LOG_UNSERIALIZABLE_REQUESTS`
2016-07-29 10:12:52 -03:00
darshanime
d8e62e660d
update log demo print
2016-07-26 20:46:12 +05:30
darshanime
0c77b6d033
update docs for settings
2016-07-25 18:05:51 +05:30
Darshan Chaudhary
472a8a47d0
Change name, log once
2016-07-25 18:03:43 +05:30
Jesús Losada
c6a2ca4e93
Document S3 capabilities in FilesPipeline and ImagesPipeline
2016-07-22 19:32:29 +02:00
Raul Gallegos
49ac7de231
prioritize default headers over user agent
2016-07-05 15:38:17 -05:00
Paul Tremberth
9b3c72cb37
DOC Place FEED_TEMPDIR setting at lexicographical position
2016-05-17 16:25:57 +02:00
Paul Tremberth
bf7f675493
Merge pull request #1847 from aron-bordin/add_blocking_storage_path_setting
...
[MRG+2] added BLOCKING_FEED_STORAGE_PATH to settings
2016-04-01 15:47:06 +02:00
Aron Bordin
9250a5bffa
added FEED_TEMPDIR to settings
2016-04-01 00:05:21 -03:00
Aron Bordin
2cfe9e424d
small doc style fixes
2016-03-05 19:54:06 -03:00
nyov
5876b9aa30
Update documentation links
2016-03-03 16:28:33 +00:00
Paul Tremberth
174f526709
Document DOWNLOADER_* settings for HTTP/1.0 and TLS
2016-02-26 18:23:57 +01:00
Konstantin Lopuhin
6137dd96d9
Fix documentation for S3_STORE_ACL (now settings.FILES_STORE_S3_ACL) settings: it has nothing to do with feed exporters.
2016-02-24 10:16:41 +03:00
Konstantin Lopuhin
164f300762
See #1778 - change default S3 ACL to "private" and allow customization via settings
2016-02-24 10:16:41 +03:00
Paul Tremberth
44d8df2060
Add versionadded note for MEMUSAGE_CHECK_INTERVAL_SECONDS
2016-02-03 12:35:26 +01:00
Paul Tremberth
d999e3f7a7
More explicit description of DEPTH_PRIORITY
2016-01-27 12:57:03 +01:00
Paul Tremberth
6ed08d2332
Add note for DEPTH_PRIORITY
2016-01-27 11:53:29 +01:00
Paul Tremberth
1c83108893
Clarify priority adjust settings docs
...
Fixes #1593
2016-01-26 19:24:11 +01:00
Mikhail Korobov
f30758c246
Enable robots.txt handling by default for new projects. Fixes GH-1668.
...
For backwards compatibility reasons the default value is not changed.
2016-01-26 17:47:46 +05:00
orangain
bcce8d3d80
DOC: Update MetaRefreshMiddlware's setting variables
...
* `REDIRECT_MAX_METAREFRESH_DELAY` has been deprecated and was
renamed to `METAREFRESH_MAXDELAY`.
* Merge duplicate documents about `METAREFRESH_MAXDELAY` appeared both
in the settings page and the downloader-middlewares page.
2015-12-17 15:25:02 +09:00
palego
2c251000d3
custom project templates
...
allow override of TEMPLATES_DIR for startproject
copy full TEMPLATES_DIR/project tree
doc update
2015-12-01 03:07:27 +01:00
Jakob de Maeyer
e66f649894
Bring back _BASE settings
2015-11-11 17:39:56 +01:00
Julia Medina
72eeead6db
Merge pull request #1524 from Digenis/relocate_telnet_console
...
[MRG+1] Relocate telnetconsole to extensions/
2015-10-30 12:10:38 -03:00
Jakob de Maeyer
26586ef5a6
Deprecate _BASE settings, unify _BASE backwards-compatibility
2015-10-27 12:43:23 +01:00
Νικόλαος-Διγενής Καραγιάννης
d523c75f5e
Relocate telnetconsole to extensions/
2015-10-05 21:16:04 +03:00
Julia Medina
8b3ca4f250
Merge pull request #1302 from eliasdorneles/improving-access-settings-docs
...
[MRG+1] Improvements for docs on how to access settings
2015-07-03 00:56:32 -03:00
Daniel Graña
3fc4e0b319
Merge pull request #1282 from otherchirps/memusage-check-interval
...
[MRG+1] Added MEMUSAGE_CHECK_INTERVAL_SECONDS to Memory usage extension options.
2015-07-02 13:50:55 -03:00
Mikhail Korobov
d850238c22
add AUTOTHROTTLE_TARGET_CONCURRENCY option and expand AutoThrottle docs
2015-06-27 04:59:42 +05:00
Elias Dorneles
2de5c66058
improvements for docs on how to access settings
2015-06-15 13:07:55 -03:00
Chris Nilsson
0c532baf4c
Removed typo, and clarified time unit of setting
2015-06-06 11:18:13 +10:00
Chris Nilsson
eae25a04d9
Added MEMUSAGE_CHECK_INTERVAL_SECONDS to Memory usage extension options.
...
Kept the default as it was, at 60.0 seconds. But added a setting to
allow this to be changed as desired.
2015-06-06 00:39:14 +10:00
Julia Medina
367ea81e71
Remove deprecated %z formatting from the default LOG_DATEFORMAT
2015-06-04 04:11:23 +08:00
Daniel Graña
1195f906d6
Merge pull request #1218 from Curita/move-base-to-packages
...
Move base classes to their packages
2015-05-14 18:28:17 -03:00
Pablo Hoffman
65aa9ccc70
Merge pull request #1220 from eliasdorneles/building-settingslist-from-docs
...
Building settings list from docs
2015-05-13 14:43:19 -03:00
Elias Dorneles
5753e498bf
fixes referencing, and list only settings not documented in current document
2015-05-09 16:15:06 -03:00
Julia Medina
d3f576a816
Move scrapy/spider.py to scrapy/spiders/__init__.py
2015-05-09 04:20:09 -03:00
Elias Dorneles
d1053d2a2f
automatic settings list for docs [WIP]
2015-05-04 02:17:19 -03:00
Julia Medina
b827097c91
Rename scrapy/statscol.py to scrapy/statscollectors.py
2015-04-29 21:36:40 -03:00
Julia Medina
54a4ce069c
Rename scrapy/dupefilter.py to scrapy/dupefilters.py
2015-04-29 21:27:19 -03:00
Julia Medina
9a3e3ba505
Move scrapy/contrib remaining top-level files to scrapy/extensions
2015-04-29 21:27:19 -03:00
Julia Medina
180272c092
Move scrapy/contrib/spidermiddleware to scrapy/spidermiddlewares
2015-04-29 21:26:35 -03:00
Julia Medina
d7c444fefb
Move scrapy/contrib/downloadermiddleware to scrapy/downloadermiddlewares
2015-04-29 21:24:30 -03:00
Julia Medina
ccdd8bfbcc
Parametrize log formatting strings
2015-04-22 17:24:40 -03:00
Mikhail Korobov
403e7c7c70
rename scrapy.spidermanager.SpiderManager to scrapy.spiderloader.SpiderLoader
2015-04-16 20:07:53 +05:00
Alexander Sibiryakov
85aa3c7596
Dns cache size and timeout options
2015-04-02 18:30:59 +02:00
Daniel Graña
27591b55fc
Merge pull request #1123 from sibiryakov/reactor-threadpool-size
...
[MRG+1] Reactor threadpool max size setting
2015-04-01 15:08:03 -03:00
Alexander Sibiryakov
e7b274edf3
Reformat to 80 characters per line.
2015-04-01 11:49:55 +02:00
Alexander Sibiryakov
94fceb4c15
Fixing underscore size.
2015-04-01 11:25:10 +02:00
