BackTrackZ/scrapy
BackTrackZ/scrapy
1
0
Fork 0
mirror of https://github.com/scrapy/scrapy.git synced 2025-02-25 21:03:40 +00:00
Code Releases Wiki Activity
3,228 Commits 39 Branches 119 Tags
Commit Graph

3228 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Pablo Hoffman
9686f97242 added precise to supported ubuntu distros 2012-05-12 19:54:36 -03:00
Pablo Hoffman
58e88ed246 scrapyd: do not set SCRAPY_FEED_URI/SCRAPY_LOG_FILE if items_dir/logs_dir settings are not set 2012-05-08 17:43:00 -03:00
Daniel Graña
43732e5042 Merge pull request #129 from saxicek/master 
ImagesPipeline should not fail if Item['images'] is not defined.
 2012-05-07 10:38:49 -07:00
Daniel Graña
69078368ab Merge pull request #130 from alexcepoi/lxml-fixes 
fix `tail` issue when extracting nodes [lxml]
 2012-05-07 08:37:36 -07:00
Alexandru Cepoi
045ff8e5a7 fix tail issue when extracting nodes [lxml] 2012-05-07 17:23:27 +02:00
Libor Nenadl
2b93b0a93c Do not try to set item['images'] if it is not defined in the Item. 2012-05-05 14:53:02 +02:00
Daniel Graña
43028876b5 Merge pull request #128 from dangra/cannonicalize-missing-url-path 
handle missing paths in urls as /
 2012-05-03 10:27:11 -07:00
Daniel Graña
72b1c2e88b handle missing paths in urls as / 2012-05-03 13:56:45 -03:00
Pablo Hoffman
9c3b9f2968 fixed bug in json-rpc webservice reported in https://groups.google.com/d/topic/scrapy-users/qgVBmFybNAQ/discussion. also removed no longer supported 'run' command from extras/scrapy-ws.py 2012-05-03 12:05:40 -03:00
Pablo Hoffman
abcac4fcbd updated maintainer to scrapinghub 2012-05-02 03:25:35 -03:00
Daniel Graña
2681be59f7 Merge pull request #127 from stav/master 
scrapy.contrib.spiders.Rule documentation indentation
 2012-04-30 12:16:45 -07:00
stav
86dba76d1f documentation indentation 2012-04-30 13:09:34 -05:00
Pablo Hoffman
f5b87dbef8 added NEWS file pointing to docs/news.rst 2012-04-28 23:32:51 -03:00
Pablo Hoffman
78185921c2 renamed and improved README to provide a more helpful github landing page 2012-04-28 23:30:00 -03:00
Daniel Graña
9d66d7cdf9 be consistent removing BOM from decoded bodies. #123 2012-04-27 00:31:03 -03:00
Daniel Graña
8cae228df1 do not treat input type "image" as form input. #111 2012-04-25 16:12:48 -03:00
Daniel Graña
5b9a7814a5 support TextResponse in open_in_browser util 2012-04-25 16:04:37 -03:00
Pablo Hoffman
7865fbf05a replace "import Image" by more standard "from PIL import Image". closes #88 2012-04-20 19:05:55 -03:00
Daniel Graña
66de3d1757 return trial status as bin/runtests.sh exit value. #118 2012-04-20 16:40:55 -03:00
Daniel Graña
db99ae3958 test more border cases for formrequest 2012-04-20 16:39:50 -03:00
Daniel Graña
28401fd47d Merge dev.scrapinghub.com:~/src/scrapy 2012-04-20 09:32:43 -03:00
Daniel Graña
29d6bcf0d1 Workaround bug in lxml for multiple select options 
In lxml version pre 2.3.1 there is a bug that returns
all options elements instead of those selected for select tag

it is mentioned in 2.3.1 release notes
http://lxml.de/2.3/changes-2.3.1.html

and fixed by
57f49eed82 (L1R1139)
 2012-04-20 12:24:30 +00:00
Pablo Hoffman
c7f33c534b removed redundant lines from release notes 2012-04-20 09:09:55 -03:00
Daniel Graña
15c8c01828 add 0.14.3 release notes 2012-04-19 23:25:15 -03:00
Daniel Graña
f34dd11c16 forgot to include pydispatch license. #118 2012-04-19 22:49:47 -03:00
Daniel Graña
771abd57c1 include egg files used by testsuite in source distribution. #118 2012-04-19 22:38:45 -03:00
Daniel Graña
8b45a00f36 Merge dangra/lxml-formrequest 2012-04-19 17:10:29 -03:00
Daniel Graña
72485128cb Add a test case to cover input elements as not direct child of form element. #111 #121 2012-04-19 16:58:01 -03:00
Daniel Graña
3b2458dbbb cleanup all FormRequest test cases. #111 #121 2012-04-19 16:48:39 -03:00
Daniel Graña
4340a13db5 More lxml FormRequest fixes. #111 #121 
* test textarea elements
* handle odd cases for select elements like chrome and FF browsers does
* Remove test case already covered by per tag test cases
 2012-04-19 16:48:31 -03:00
Daniel Graña
84d5f5ea53 test and fix each form input type with border cases. #111 #121 2012-04-19 15:40:07 -03:00
Daniel Graña
63e4355fba find form input elements using one xpath #111 #121 2012-04-19 14:11:13 -03:00
Daniel Graña
5c03c1df2d Merge pull request #121 from artem-dev/master 
fix FormRequest for case when a form values are missed
 2012-04-19 08:18:02 -07:00
Pablo Hoffman
97f362d64e removed deprecated/undocumented class: HTMLImageLinkExtractor 2012-04-19 12:07:46 -03:00
Artem Bogomyagkov
3a7c28f155 fixed FormRequest for a form missed values case 2012-04-19 18:07:38 +03:00
Pablo Hoffman
13ac6f63eb Merge pull request #119 from andrix/fix-htmlimagelinkextractor 
Fix HTMLImageLinkExtractor to work with libxml2 and lxml selectors
 2012-04-19 07:56:38 -07:00
Pablo Hoffman
1e521a3ff3 improved command line tool usage help which explains that more commands are available when run from project directory. refs #107 2012-04-19 02:54:57 -03:00
Pablo Hoffman
2fb5e62c39 doc: update overview page to point to the genspider command. refs #107 2012-04-19 02:37:22 -03:00
Pablo Hoffman
1c5294bee1 update docstring in project template to avoid confusion with genspider command, which may be considered as an advanced feature. refs #107 2012-04-19 02:35:48 -03:00
Pablo Hoffman
d567d8efbe added note to docs/topics/firebug.rst about google directory being shut down 2012-04-19 01:34:20 -03:00
Daniel Graña
21e03729a3 lxml is the new default selector backend. closes #120 2012-04-19 00:28:27 -03:00
Daniel Graña
6bb40fe5a8 use xpath to match img tags in one shot. #119 2012-04-19 00:03:04 -03:00
Andrés Moreira
e24107feb8 fix HTMLImageLinkExtractor to work with libxml2 and lxml selectors 2012-04-18 18:05:44 -03:00
Pablo Hoffman
30ddbf624e mention about some scrapy.xlib modules removed in the release notes 2012-04-17 12:31:18 -03:00
Pablo Hoffman
d99ee6deb9 added some missing entries to release notes 2012-04-17 12:29:48 -03:00
Daniel Graña
60ee5d6213 Merge branch 'lxml-formrequest' 2012-04-15 00:47:39 -03:00
Daniel Graña
5b0df465e7 SELECT matched as form inputs but hasnot type attribute. #111 2012-04-15 00:47:30 -03:00
Daniel Graña
150e5734d3 Merge pull request #111 from LucianU/lxml-formrequest 
Lxml formrequest
 2012-04-13 12:29:04 -07:00
Daniel Graña
39395eb4f7 iteritems returns tuple elements duh!. #111 2012-04-13 16:22:25 -03:00
Daniel Graña
b88bdd05c4 do not add clickable if it is in formdata. #111 2012-04-13 16:20:35 -03:00