BackTrackZ/scrapy
BackTrackZ/scrapy
1
0
Fork 0
mirror of https://github.com/scrapy/scrapy.git synced 2025-02-26 19:03:53 +00:00
Code Releases Wiki Activity
3,297 Commits 39 Branches 119 Tags
Commit Graph

3297 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Daniel Graña
3d6edc2f40 Merge pull request #135 from alexcepoi/parse-changes 
Add --depth option to parse
 2012-06-07 07:52:27 -07:00
Alexandru Cepoi
3b5cf31198 add --verbose option to parse command 2012-05-24 16:35:09 +02:00
Alexandru Cepoi
8e3c5f1bf7 add --depth field to parse command 2012-05-24 15:10:03 +02:00
Pablo Hoffman
8d77005047 scrapy shell: start shell in main thread and crawler in secondary thread, instead of the other way around. fixes #100 2012-05-22 19:15:54 -03:00
Pablo Hoffman
b33303779a scrapyd.launcher: make SCRAPY_LOG_FILE and SCRAPY_FEED_URI optional 2012-05-21 14:29:15 -03:00
Daniel Graña
35ef7de546 add travis-ci build status to README 2012-05-17 09:07:36 -03:00
Daniel Graña
e77e4b5f6e add precise to travis-ci build enviroments 2012-05-17 09:03:28 -03:00
Daniel Graña
3096e46401 add requirements file per travis env 2012-05-17 08:53:18 -03:00
Daniel Graña
7740581f88 Merge remote-tracking branch 'upstream/master' 2012-05-17 08:50:28 -03:00
Daniel Graña
c3a3108799 multiple build enviroments for travis-ci 2012-05-17 08:49:45 -03:00
Pablo Hoffman
1bc18434f5 removed obsolete entries from MANIFEST.in 2012-05-17 01:09:48 -03:00
Daniel Graña
7fc573a230 fix libxml2 test 2012-05-16 18:54:02 -03:00
Daniel Graña
f530b0b3eb make libxml2 optional now that lxml is the default 2012-05-16 18:17:51 -03:00
Daniel Graña
8376d95ce8 add travis-ci build configuration file 2012-05-16 16:54:12 -03:00
Pablo Hoffman
b4f368c37e warn if Link objects are instantiated with unicode urls 2012-05-16 13:12:25 -03:00
Pablo Hoffman
30b6c77ce5 fixed typo in previous commit 2012-05-16 09:16:46 -03:00
Pablo Hoffman
b53bc66c76 added lxml/libxml2 versions to 'scrapy version' output 2012-05-16 09:12:02 -03:00
Daniel Graña
d74a067227 require w3lib 1.2 or greater 2012-05-15 17:11:51 -03:00
Daniel Graña
ae2ff4d33a update news file with 0.14.4 release notes 2012-05-15 16:16:02 -03:00
Pablo Hoffman
9686f97242 added precise to supported ubuntu distros 2012-05-12 19:54:36 -03:00
Pablo Hoffman
58e88ed246 scrapyd: do not set SCRAPY_FEED_URI/SCRAPY_LOG_FILE if items_dir/logs_dir settings are not set 2012-05-08 17:43:00 -03:00
Daniel Graña
43732e5042 Merge pull request #129 from saxicek/master 
ImagesPipeline should not fail if Item['images'] is not defined.
 2012-05-07 10:38:49 -07:00
Daniel Graña
69078368ab Merge pull request #130 from alexcepoi/lxml-fixes 
fix `tail` issue when extracting nodes [lxml]
 2012-05-07 08:37:36 -07:00
Alexandru Cepoi
045ff8e5a7 fix tail issue when extracting nodes [lxml] 2012-05-07 17:23:27 +02:00
Libor Nenadl
2b93b0a93c Do not try to set item['images'] if it is not defined in the Item. 2012-05-05 14:53:02 +02:00
Daniel Graña
43028876b5 Merge pull request #128 from dangra/cannonicalize-missing-url-path 
handle missing paths in urls as /
 2012-05-03 10:27:11 -07:00
Daniel Graña
72b1c2e88b handle missing paths in urls as / 2012-05-03 13:56:45 -03:00
Pablo Hoffman
9c3b9f2968 fixed bug in json-rpc webservice reported in https://groups.google.com/d/topic/scrapy-users/qgVBmFybNAQ/discussion. also removed no longer supported 'run' command from extras/scrapy-ws.py 2012-05-03 12:05:40 -03:00
Pablo Hoffman
abcac4fcbd updated maintainer to scrapinghub 2012-05-02 03:25:35 -03:00
Daniel Graña
2681be59f7 Merge pull request #127 from stav/master 
scrapy.contrib.spiders.Rule documentation indentation
 2012-04-30 12:16:45 -07:00
stav
86dba76d1f documentation indentation 2012-04-30 13:09:34 -05:00
Pablo Hoffman
f5b87dbef8 added NEWS file pointing to docs/news.rst 2012-04-28 23:32:51 -03:00
Pablo Hoffman
78185921c2 renamed and improved README to provide a more helpful github landing page 2012-04-28 23:30:00 -03:00
Daniel Graña
9d66d7cdf9 be consistent removing BOM from decoded bodies. #123 2012-04-27 00:31:03 -03:00
Daniel Graña
8cae228df1 do not treat input type "image" as form input. #111 2012-04-25 16:12:48 -03:00
Daniel Graña
5b9a7814a5 support TextResponse in open_in_browser util 2012-04-25 16:04:37 -03:00
Pablo Hoffman
7865fbf05a replace "import Image" by more standard "from PIL import Image". closes #88 2012-04-20 19:05:55 -03:00
Daniel Graña
66de3d1757 return trial status as bin/runtests.sh exit value. #118 2012-04-20 16:40:55 -03:00
Daniel Graña
db99ae3958 test more border cases for formrequest 2012-04-20 16:39:50 -03:00
Daniel Graña
28401fd47d Merge dev.scrapinghub.com:~/src/scrapy 2012-04-20 09:32:43 -03:00
Daniel Graña
29d6bcf0d1 Workaround bug in lxml for multiple select options 
In lxml version pre 2.3.1 there is a bug that returns
all options elements instead of those selected for select tag

it is mentioned in 2.3.1 release notes
http://lxml.de/2.3/changes-2.3.1.html

and fixed by
57f49eed82 (L1R1139)
 2012-04-20 12:24:30 +00:00
Pablo Hoffman
c7f33c534b removed redundant lines from release notes 2012-04-20 09:09:55 -03:00
Daniel Graña
15c8c01828 add 0.14.3 release notes 2012-04-19 23:25:15 -03:00
Daniel Graña
f34dd11c16 forgot to include pydispatch license. #118 2012-04-19 22:49:47 -03:00
Daniel Graña
771abd57c1 include egg files used by testsuite in source distribution. #118 2012-04-19 22:38:45 -03:00
Daniel Graña
8b45a00f36 Merge dangra/lxml-formrequest 2012-04-19 17:10:29 -03:00
Daniel Graña
72485128cb Add a test case to cover input elements as not direct child of form element. #111 #121 2012-04-19 16:58:01 -03:00
Daniel Graña
3b2458dbbb cleanup all FormRequest test cases. #111 #121 2012-04-19 16:48:39 -03:00
Daniel Graña
4340a13db5 More lxml FormRequest fixes. #111 #121 
* test textarea elements
* handle odd cases for select elements like chrome and FF browsers does
* Remove test case already covered by per tag test cases
 2012-04-19 16:48:31 -03:00
Daniel Graña
84d5f5ea53 test and fix each form input type with border cases. #111 #121 2012-04-19 15:40:07 -03:00