BackTrackZ/scrapy
BackTrackZ/scrapy
1
0
Fork 0
mirror of https://github.com/scrapy/scrapy.git synced 2025-02-25 13:03:47 +00:00
Code Releases Wiki Activity
1,854 Commits 39 Branches 119 Tags
Commit Graph

1854 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Pablo Hoffman
720bc166cf updated new clickdata argument doc 2009-10-20 17:21:56 -02:00
Daniel Grana
6abb3c17ee Improve FormRequest.from_response method to pass click data arguments to ClientForm library 2009-10-20 15:51:41 -02:00
daniel
789cba2bd8 improve csviter memeory usage by use of a generator instead of splitlines 2009-10-15 16:26:05 +01:00
Daniel Grana
d6735b3952 do not modify request.headers inside http download handler 2009-10-15 11:19:52 -02:00
Daniel Grana
cc85c463ae add missing lxml iterators module 2009-10-14 18:37:51 -02:00
Daniel Grana
23c49bcb3f move lxml based xmliter function to contrib_exp 2009-10-14 13:22:28 -02:00
Daniel Grana
6bb84f0797 remove response body references from experimental decompression mw 2009-10-13 16:38:49 -02:00
Daniel Grana
f7fbbfec29 rollback xmliter functions to private, we won\'t support multiples versions of xmliter 2009-10-10 23:31:16 -02:00
Daniel Grana
6db5a37cdb do specialized xmliter public functions and add tests 2009-10-09 17:00:31 -02:00
daniel
51c4be78d7 Add a lxml based xmliter function enabled by default if lxml is available 2009-10-09 04:02:48 +01:00
daniel
af09029649 trackref Libxml2Document objects and do not silence xml exceptions on __del__ 2009-10-08 16:32:42 +01:00
daniel
d7024dcd33 urllib does not support no_proxy in python < 2.6. Skip it tests. 2009-10-08 16:31:37 +01:00
Pablo Hoffman
2712d55cb9 Automated merge with http://hg.scrapy.org/scrapy-stable 2009-10-07 23:58:38 -02:00
Pablo Hoffman
10d6d49085 Added tag 0.7 for changeset 2077c6107e33 2009-10-07 23:57:04 -02:00
Pablo Hoffman
bd481751d8 moved images pipeline documentation to stable doc 
--HG--
rename : docs/experimental/images.rst => docs/topics/images.rst
0.7 		2009-10-07 22:57:25 -02:00
Pablo Hoffman
b4d202a6b0 added note about memory usage extension not working on windows 2009-10-07 22:57:10 -02:00
Pablo Hoffman
daf86144c8 another win32 bug fixed in images pipeline (regression tests already covered it) 2009-10-07 22:39:19 -02:00
Pablo Hoffman
5c68e2b34b fixed bug in images pipeline bug in win32 systems, and added regression tests 2009-10-07 22:34:38 -02:00
Pablo Hoffman
937acd91d1 improved documentation of http proxy middleware 2009-10-07 21:00:34 -02:00
Pablo Hoffman
d03bf1f27f Automated merge with http://hg.scrapy.org/scrapy-stable 2009-10-07 20:38:46 -02:00
Pablo Hoffman
37d9e015bb minor fix to tutorial 2009-10-07 20:15:49 -02:00
Pablo Hoffman
1450af257a some improvements to 'Crawled' log lines, delegating the formatting to a pluggable function 2009-10-06 22:47:17 -02:00
Daniel Grana
bc64ca3e13 Add support to set http proxies per request, and obey enviroment variables http_proxy and no_proxy by default. 2009-10-05 04:10:22 -02:00
Daniel Grana
8aa7d153ae rewrote of downloader handlers 
* add REQUEST_HANDLERS setting with defaults for file, http and https schemes
* add documentation of new setting
* add unittests for all the builtin handlers
* remove unused getPage function
 2009-10-05 04:10:22 -02:00
Pablo Hoffman
40dc867ac3 Automated merge with http://hg.scrapy.org/scrapy-stable 2009-10-03 14:09:21 -03:00
Pablo Hoffman
aacb7965b4 improved check for missing callback in Requests 2009-10-03 14:08:40 -03:00
Pablo Hoffman
9710f2635a Automated merge with http://hg.scrapy.org/scrapy-stable 2009-10-02 09:21:21 -03:00
Pablo Hoffman
0f1bb87198 fixed bug in parse command with requests which don't have __dict__ attribute 2009-10-02 09:20:22 -03:00
Ismael Carnales
64ad96ba1e added LxmlItemLoader 2009-09-29 16:17:30 -03:00
Pablo Hoffman
ea9f2360eb merge with scrapy-stable 2009-09-29 16:16:35 -03:00
Ismael Carnales
bb4871b7a7 added xpathitemloader tests 2009-09-29 16:05:34 -03:00
Ismael Carnales
16ada1d5dc fixed ItemLoader replace_value 2009-09-29 16:05:32 -03:00
Pablo Hoffman
64ce9542d2 Automated merge with http://hg.scrapy.org/scrapy-stable 
--HG--
rename : extras/make_release.sh => extras/build_release.sh
 2009-09-29 14:22:10 -03:00
Pablo Hoffman
a0eec7eaf6 some typos fixes and updates to install doc 2009-09-29 09:44:02 -03:00
Pablo Hoffman
4a371a6cd3 removed unmaintained spidermonkey bindings 2009-09-29 09:33:20 -03:00
Ismael Carnales
1646482bef reformatted installation guide 2009-09-29 08:41:34 -03:00
Pablo Hoffman
f565127eb2 added some missing file to MANIFEST.in 2009-09-28 23:55:00 -03:00
Pablo Hoffman
4a9d9282bc removed obsolete scrapy architecture dia diagram 2009-09-28 23:54:01 -03:00
Pablo Hoffman
7e12d3d41b removed old adaptors tests sample data 2009-09-28 23:16:17 -03:00
Pablo Hoffman
7428e4cebf splitted make_release.sh in: build_release.sh and sign_release.sh 
--HG--
rename : extras/make_release.sh => extras/build_release.sh
 2009-09-28 23:07:00 -03:00
Pablo Hoffman
1dcb9ed72f Merge with stable repo 2009-09-28 22:53:05 -03:00
Pablo Hoffman
504293b8c4 renamed tag: 0.7.0-rc1 to 0.7-rc1 2009-09-28 22:29:23 -03:00
Pablo Hoffman
2be739964d bumped version to 0.7 final 2009-09-28 22:28:49 -03:00
Daniel Grana
e0ccb2cceb ignore request if spider is not opened in downloader when called from engine.download 2009-09-28 12:44:05 -03:00
Daniel Grana
749b136595 Automated merge with ssh://hg.scrapy.org/scrapy-stable 2009-09-28 12:40:16 -03:00
Daniel Grana
1f9e0f10eb don't log ignored requests errors at images pipeline 2009-09-28 12:38:49 -03:00
Daniel Grana
706cb439c5 Automated merge with ssh://hg.scrapy.org/scrapy-stable 2009-09-23 14:54:33 -03:00
Daniel Grana
c795771282 remove unused line from project settings template 2009-09-23 14:53:40 -03:00
Daniel Grana
bd0dc21e8d Automated merge with ssh://hg.scrapy.org/scrapy-stable 2009-09-23 14:28:41 -03:00
Daniel Grana
dfd35c5280 Add common javascript mimetypes to be detected as TextResponses, also improve mimetype detection to avoid querying twice classes dict 2009-09-23 14:26:58 -03:00