1
0
mirror of https://github.com/scrapy/scrapy.git synced 2025-02-24 07:43:48 +00:00

5761 Commits

Author SHA1 Message Date
Paul Tremberth
ec4ab126b6 Merge pull request #2220 from scrapy/comment-typo-fix
typo fix in HttpProxyMiddleware
2016-09-07 10:15:12 +02:00
Mikhail Korobov
960b1bc8f0 typo fix in HttpProxyMiddleware 2016-09-07 04:54:32 +05:00
Paul Tremberth
9e6a72cc4b Merge pull request #2217 from stummjr/add-analytics-to-docs
[MRG+1] Add Segment Analytics to Documentation
2016-09-05 15:59:58 +02:00
Valdir Stumm Junior
9cea6f0730 Add Segment Analytics to Documentation 2016-09-02 14:51:07 -03:00
Paul Tremberth
eedb6ce774 Merge pull request #2190 from stummjr/fix-docs
[MRG+1] Fix RANDOMIZE_DOWNLOAD_DELAY description in the docs
2016-08-31 11:51:47 +02:00
Elias Dorneles
1e95bf59ef Merge pull request #2197 from thomdixon/improve-response-documentation
[MRG+1] Correct documentation about Response parameters
2016-08-29 11:08:30 -03:00
Thom Dixon
f68dc3026d Fix indentation 2016-08-24 09:11:27 -07:00
Thom Dixon
633abfbea1 Correct documentation about Response parameters
This fixes issue #2196
2016-08-24 08:47:52 -07:00
Valdir Stumm Junior
d61650d843 fix RANDOMIZE_DOWNLOAD_DELAY description in the docs 2016-08-19 18:24:32 -03:00
Paul Tremberth
cacd038b10 Merge pull request #2188 from scrapy/release-notes-1.1.2-master
Add release notes for 1.1.2 version
2016-08-19 17:04:28 +02:00
Paul Tremberth
f18c3e5ce5 Add release notes for 1.1.2 version 2016-08-19 17:01:57 +02:00
Paul Tremberth
9de6f1ca75 Merge pull request #1905 from rootAvish/duplication-fix
[MRG+1] Modified read failure recovery in utils/gz.py to read only the last f.extrasize bytes of f.extrabuf[ ]
2016-08-17 14:51:30 +02:00
Mikhail Korobov
241bd00e76 Merge pull request #2168 from advarisk/w3lib-canonicalize-url
[MRG+1] Use w3lib.url.canonicalize_url() from w3lib 1.15.0
2016-08-16 20:59:17 +06:00
Ashish Kulkarni
bb3b806467 Use w3lib.url.canonicalize_url() from w3lib 1.15.0
Also remove code/imports which are now unused due to this change.

fixes #2157
2016-08-16 17:42:16 +05:30
Paul Tremberth
9a734e6759 Merge pull request #2058 from dalleng/serialize_set
[MRG+1] Add set serialization to ScrapyJSONEncoder
2016-08-12 18:28:34 +02:00
rootavish
d9437fd3d9 Modifying existing gzip read failure recovery mechanism to patch read for broken archives 2016-08-11 18:21:42 +05:30
Paul Tremberth
1ec210068f Merge pull request #2169 from Tethik/parse_command_callback_typo
[MRG+1] Typo fix for error in parse command
2016-08-11 11:52:59 +02:00
Joakim Uddholm
625c69fdc7 Fixed typo in error message when selecting a callback method for the parse command. 2016-08-08 14:32:53 +02:00
Mikhail Korobov
414857a593 Merge pull request #2140 from jesuslosada/images-expires
[MRG+1] Fix IMAGES_EXPIRES default value
2016-08-05 21:52:27 -04:00
Mikhail Korobov
fa78849e33 Merge pull request #2165 from loreguerra/master
[MRG+1] Updated architecture graph for organization/clarity
2016-08-05 21:46:28 -04:00
Lorena
7d432872bf text updates to match graphic 2016-08-04 11:01:14 -07:00
Lorena
04f93e096c updated graph for organization/clarity 2016-08-04 10:04:47 -07:00
Paul Tremberth
27d4cea6a5 Merge pull request #2161 from redapple/release-notes-1.1.1-master
Release notes for 1.1.1
2016-08-01 20:50:14 +02:00
Paul Tremberth
5b1d98b8c8 Update 1.1.1 release date 2016-08-01 20:21:12 +02:00
Paul Tremberth
928e93f8f3 Update notes with latest 1.1 commits 2016-08-01 20:21:12 +02:00
Paul Tremberth
e1d118d5ca Update release notes for upcoming 1.1.1 release 2016-08-01 20:21:12 +02:00
Paul Tremberth
2a0a96aef0 Merge pull request #2160 from stummjr/patch-1
[MRG+1] Remove README download count badge
2016-08-01 17:57:57 +02:00
Valdir Stumm Jr
63876fc690 Remove download stats badge 2016-08-01 12:16:50 -03:00
Mikhail Korobov
2c9a38d1f5 Merge pull request #2153 from Digenis/Selector_bad_args
[MRG+1] Selector should not receive both response and text
2016-07-31 21:28:38 -04:00
Νικόλαος-Διγενής Καραγιάννης
643dbeffcf Selector should not receive both response and text 2016-07-30 10:35:16 +03:00
Elias Dorneles
34e7dadf38 Merge pull request #1610 from darshanime/scheduler_debug
[MGR+1] Change, document `LOG_UNSERIALIZABLE_REQUESTS`
2016-07-29 10:12:52 -03:00
darshanime
d8e62e660d update log demo print 2016-07-26 20:46:12 +05:30
Paul Tremberth
fe68a45c82 Merge pull request #2138 from jesuslosada/master
[MRG+1] Apply the FILES_STORE_S3_ACL setting in ImagesPipeline
2016-07-26 12:50:25 +02:00
Elias Dorneles
b6375d3701 Merge pull request #1566 from darshanime/signal-example
[MRG+1] Include example for signal docs
2016-07-25 10:49:29 -03:00
Darshan Chaudhary
a2e6452554 Include signal example 2016-07-25 18:41:25 +05:30
darshanime
0c77b6d033 update docs for settings 2016-07-25 18:05:51 +05:30
Darshan Chaudhary
2d9e5937c6 Include deprecated warning 2016-07-25 18:05:51 +05:30
Darshan Chaudhary
472a8a47d0 Change name, log once 2016-07-25 18:03:43 +05:30
Jesús Losada
8221556089 Add documentation on Amazon S3 ACLs 2016-07-22 23:22:18 +02:00
Diego Allen
e17fdd7276 Add set serialization to ScrapyJSONEncoder 2016-07-22 17:20:03 -04:00
Jesús Losada
7c3e3b484e Fix ImagesPipeline test settings 2016-07-22 20:03:49 +02:00
Jesús Losada
f193c52acd Fix IMAGES_EXPIRES default value
The default value should be 90.
2016-07-22 19:47:29 +02:00
Jesús Losada
c6a2ca4e93 Document S3 capabilities in FilesPipeline and ImagesPipeline 2016-07-22 19:32:29 +02:00
Jesús Losada
f72991a96b Add the IMAGES_STORE_S3_ACL setting 2016-07-22 19:18:13 +02:00
Paul Tremberth
ec1c61504a Merge pull request #2005 from feliperuhland/master
[MRG+1] Included new optional parameter in startproject command line
2016-07-19 12:31:06 +02:00
Felipe Ruhland
fe088925a3 Included implementation notes in docstring
Signed-off-by: Felipe Ruhland <felipe.ruhland@gmail.com>
2016-07-19 00:12:39 -03:00
Felipe Ruhland
de64a1f68a Fix scrapy.cfg validation
Signed-off-by: Felipe Ruhland <felipe.ruhland@gmail.com>
2016-07-19 00:04:45 -03:00
Elias Dorneles
a86562b72b Merge pull request #2128 from kas/patch-1
(docs) Minor grammar fix in logging.rst
2016-07-18 09:24:03 -03:00
Kenneth Schnall
5fabed514e Update logging.rst 2016-07-15 23:14:11 -04:00
Mikhail Korobov
79639d0fec Merge pull request #1989 from pawelmhm/fix-images-pipeline-uppercase-other
[MRG+1] [image_pipeline] bring back uppercase class attributes
2016-07-13 14:44:00 +00:00