1
0
mirror of https://github.com/scrapy/scrapy.git synced 2025-02-24 23:23:47 +00:00

1218 Commits

Author SHA1 Message Date
Konstantin Lopuhin
e7c4806c5e Update feedstorage docs: add botocore, mention that boto is supported only on Python 2 2016-02-15 19:59:48 +03:00
Elias Dorneles
164493df2e add deprecation for pydispatch (thanks for the help @redapple) 2016-02-11 16:15:28 -02:00
Nicolas Pennequin
6efc7a9de0 Update the email doc for the charset argument to send(). 2016-02-04 19:33:44 +01:00
Elias Dorneles
ca08314654 makes more explicit source of problems in Python 3 limitations 2016-02-03 21:38:25 -02:00
Elias Dorneles
2167573b32 fix comment about disabling robots.txt 2016-02-03 21:31:27 -02:00
Elias Dorneles
3180abc800 applying more review comments 2016-02-03 21:28:05 -02:00
Elias Dorneles
d40add7b27 add note about robots.txt waiting and make it explicit builtin extensions only are ported 2016-02-03 21:18:25 -02:00
Elias Dorneles
9cfefd5277 favor beta over basic to describe PY3 support 2016-02-03 20:59:56 -02:00
Elias Dorneles
2f697ce59f added note about how to revert to old behavior for robotstxt 2016-02-03 20:51:26 -02:00
Elias Dorneles
89a088b3c3 applying review comments 2016-02-03 20:45:55 -02:00
Paul Tremberth
972f192568 Blank line before CoC 2016-02-03 22:58:49 +01:00
Paul Tremberth
728e505e53 Merge remote-tracking branch 'origin/master' into release-notes-1.1 2016-02-03 22:47:15 +01:00
Valdir Stumm Jr
dd7b0eb359 Updates to release notes 2016-02-03 19:23:02 -02:00
Paul Tremberth
51dc741fa2 Add 1.0.5 release notes 2016-02-03 21:07:21 +01:00
Valdir Stumm Jr
0f816524e8 edit API changes, Deprecations, and Relocations sections. 2016-02-03 16:21:32 -02:00
Paul Tremberth
fd3193da86 Reword some of "New Features and Enhancements" 2016-02-03 18:19:38 +01:00
Paul Tremberth
3b2a6abc0b Format "Code refactoring" subsection 2016-02-03 17:37:58 +01:00
Paul Tremberth
ed02455010 Format "Logging" subsection 2016-02-03 17:27:43 +01:00
Valdir Stumm Jr
1fd95c9c9f fixed references to issues and fit text to 80 cols in the first two sections 2016-02-03 12:45:48 -02:00
Valdir Stumm Jr
a21c90bee7 edits on Py3 Support and New features sections 2016-02-03 11:54:46 -02:00
Paul Tremberth
44d8df2060 Add versionadded note for MEMUSAGE_CHECK_INTERVAL_SECONDS 2016-02-03 12:35:26 +01:00
Paul Tremberth
2b033eebce Fix recently added HTTPCACHE_ settings versionadded notes 2016-02-03 12:34:44 +01:00
Paul Tremberth
142aa21737 Add AUTOTHROTTLE_TARGET_CONCURRENCY versionadded note 2016-02-03 12:33:10 +01:00
Paul Tremberth
db0697bc06 Add 1.1 release notes (draft) 2016-02-03 12:32:40 +01:00
Paul Tremberth
c6f374f2eb Merge remote-tracking branch 'origin/master' into 1550-shell_file-cont 2016-01-28 14:02:48 +01:00
Paul Tremberth
27fb200e45 Merge pull request #1727 from redapple/priority-adjust
[MRG+1] Clarify priority adjust settings docs
2016-01-27 18:52:39 +01:00
Mikhail Korobov
7ca9ae1976 DOC typo fix 2016-01-27 17:54:28 +05:00
Paul Tremberth
d999e3f7a7 More explicit description of DEPTH_PRIORITY 2016-01-27 12:57:03 +01:00
Paul Tremberth
6ed08d2332 Add note for DEPTH_PRIORITY 2016-01-27 11:53:29 +01:00
Mikhail Korobov
4bcbb77bcc response.text. Fixes GH-1729. 2016-01-27 01:28:11 +05:00
Paul Tremberth
1c83108893 Clarify priority adjust settings docs
Fixes #1593
2016-01-26 19:24:11 +01:00
Paul Tremberth
bb1f4013a3 Rewrite warning about shell with local files as note 2016-01-26 17:23:28 +01:00
Mikhail Korobov
f30758c246 Enable robots.txt handling by default for new projects. Fixes GH-1668.
For backwards compatibility reasons the default value is not changed.
2016-01-26 17:47:46 +05:00
Νικόλαος-Διγενής Καραγιάννης
1cffa99e0d tests+doc for subdomains in offsite middleware 2016-01-26 12:49:43 +02:00
Paul Tremberth
713e1eee9b Update docs about local files support for "scrapy shell" 2016-01-26 10:44:38 +01:00
Raul Gallegos
a06a5f00f4 adding configurable encoding for httpproxy authentication 2016-01-21 09:35:04 -05:00
Elias Dorneles
d4c4ca8062 fix version number to appear new feature 2016-01-21 09:42:15 -02:00
Capi Etheriel
659715ecd9 implements FormRequest.from_response CSS support 2016-01-21 01:05:20 -02:00
Daniel Graña
b1e44436bc Merge pull request #1642 from orangain/doc-metarefresh
[MRG+1] DOC: Update MetaRefreshMiddlware's setting variables
2016-01-19 13:33:50 -03:00
carlosp420
e15f361b05 fixed typo You -> you 2016-01-19 11:12:43 -05:00
Ralph Gutkowski
79147a61a7 Update stats.rst 2016-01-15 19:25:56 +01:00
Ralph Gutkowski
bb38400db5 Update Stats Collection documentation
`pages_crawled` value doesn't exist. Replace it with `downloader/response_count` in order to avoid confusion.
2016-01-15 19:00:58 +01:00
Valdir Stumm Jr
2abc9bc901 Update deprecated examples
* update the scrapy.org example to deal with the new layout.
* replaced slashdot.org by reddit.com, because it seems that slashdot is blocking requests.
2016-01-06 10:29:45 -02:00
Daniel Graña
1b435b2887 Add 1.0.4 release notes 2015-12-30 15:43:54 -03:00
orangain
bcce8d3d80 DOC: Update MetaRefreshMiddlware's setting variables
* `REDIRECT_MAX_METAREFRESH_DELAY` has been deprecated and was
  renamed to `METAREFRESH_MAXDELAY`.
* Merge duplicate documents about `METAREFRESH_MAXDELAY` appeared both
  in the settings page and the downloader-middlewares page.
2015-12-17 15:25:02 +09:00
orangain
4be4ef038e DOC: Add captions to toctrees which appear in sidebar 2015-12-12 16:21:00 +09:00
Rolando Espinoza
f8ae99d18f DOC Removed pywin32 from install instructions as it's already declared as dependency. 2015-12-05 09:48:17 -04:00
palego
2c251000d3 custom project templates
allow override of TEMPLATES_DIR for startproject
copy full TEMPLATES_DIR/project tree
doc update
2015-12-01 03:07:27 +01:00
Pablo Hoffman
eb4daa34a2 Merge pull request #1544 from rolando/conda-docs
Added installation notes about using Conda for Windows.
2015-11-26 14:11:28 -03:00
Rolando Espinoza
cc8ddb68b0 Added installation notes about using Conda for Windows and other OSes. 2015-11-26 13:08:56 -04:00