BackTrackZ/scrapy
BackTrackZ/scrapy
1
0
Fork 0
mirror of https://github.com/scrapy/scrapy.git synced 2025-02-22 11:33:21 +00:00
Code Releases Wiki Activity
4,257 Commits 39 Branches 119 Tags
Commit Graph

4257 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Daniel Graña
aaf531c7dc fix Twisted package name 2014-07-30 19:45:08 -03:00
Daniel Graña
eb1cf303d3 use pytest.ini to enable twisted plugin 2014-07-30 19:45:08 -03:00
Daniel Graña
caab9f29f2 move tests requirements under tests dir 2014-07-30 19:45:08 -03:00
Daniel Graña
242c08553f move tests under root dir 2014-07-30 19:45:08 -03:00
Daniel Graña
51feb4b620 Merge pull request #820 from lisimia/patch-1 
Update shell.rst typo
 2014-07-28 13:33:29 -03:00
Lisimia
b6b44a33f7 Update shell.rst typo 
There was a typo. 
"start" was mistyped as "star"
 2014-07-28 12:26:13 -04:00
Daniel Graña
8f4e63cda3 Merge branch 'py3-port' 2014-07-24 15:38:21 -03:00
Daniel Graña
0cf035dcbd Add tox env for python 3.4 2014-07-24 15:38:04 -03:00
Daniel Graña
79aba9e314 pytest 2.6.0 is on pypi now 2014-07-24 15:37:43 -03:00
Daniel Graña
6d215a1b34 items: Use BaseItem.__hash__ and six.add_metaclass decorator 2014-07-24 15:37:10 -03:00
Felix Yan
dbc9b37365 PY3: use MutableMapping instead of DictMixin 2014-07-25 00:34:01 +08:00
Mikhail Korobov
d7d9f2f96d Merge pull request #814 from eliasdorneles/adding-some-xpath-tips 
Adding some xpath tips to selectors docs
 2014-07-24 08:04:05 +06:00
Elias Dorneles
c298eaf164 removes weird indentation in the shell results 2014-07-23 20:42:36 -03:00
Elias Dorneles
514e8582d0 improved explanations, clarified blog post as source, added link for XPath string functions in the spec 2014-07-23 19:43:57 -03:00
Daniel Graña
16ed92d75c Merge pull request #815 from nramirezuy/retry_timeout-583 
renamed UserTimeoutError and ServerTimeouterror #583
 2014-07-23 18:28:43 -03:00
nramirezuy
ebf76867bd renamed UserTimeoutError and ServerTimeouterror #583 2014-07-23 18:11:12 -03:00
Elias Dorneles
80de43ddab adding some xpath tips to selectors docs 2014-07-22 23:20:53 -03:00
Pablo Hoffman
4cf6a3b4b3 Merge pull request #812 from kmike/fix-w3lib-trunk 
fix tests to account for https://github.com/scrapy/w3lib/pull/23
 2014-07-22 15:54:42 -03:00
Mikhail Korobov
af0635e229 fix tests to account for https://github.com/scrapy/w3lib/pull/23 2014-07-22 04:15:13 +06:00
Daniel Graña
f6b1e9b7c2 Merge pull request #803 from felixonmars/py3-port 
[MRG] PY3: use six.BytesIO and six.moves.cStringIO
 2014-07-21 14:17:42 -03:00
Daniel Graña
dd3b77ea2e Merge pull request #809 from nramirezuy/get_func_args-728 
get_func_args maximum recursion fix #728
 2014-07-21 13:41:03 -03:00
nramirezuy
86f61a9906 get_func_args maximum recursion fix #728 2014-07-21 13:12:59 -03:00
Pablo Hoffman
e748ca50ca Merge pull request #804 from darkrho/issue-560 
Updated input/ouput processor example according to #560.
hojo 		2014-07-16 17:14:53 -03:00
Pablo Hoffman
a17d417281 Merge pull request #805 from darkrho/spiderstate-jobdir 
For consistency, use `job_dir` helper in `SpiderState` extension.
 2014-07-16 17:11:20 -03:00
Rolando Espinoza
85b52b0654 For consistency, use job_dir helper in SpiderState extension. 
The `SpiderState` extension is the only place not using the `job_dir`
helper.

This might cause an error in case JOBDIR is a nested path which does not
exists, although this is least likely by default given the job dir being
set up earlier.
 2014-07-16 10:34:42 -04:00
Rolando Espinoza
e441a01818 Updated input/ouput processor example according to #560. 2014-07-16 09:04:48 -04:00
Felix Yan
1cd9c4d653 fix tests by using a tempfile instead of BytesIO 2014-07-15 21:26:01 +08:00
Felix Yan
0786e84a33 use io.BytesIO and cStringIO instead of six.BytesIO as suggested 2014-07-15 20:51:12 +08:00
Felix Yan
ef8872a518 use .seek(0) instead of reset() for compatibility 
Since I don't find docs for the .reset() method, I lookup up the source
code, and it should work just the same as .seek(0).

For reference:
8eeb7e9122/Modules/cStringIO.c (L281)
 2014-07-15 16:24:57 +08:00
Felix Yan
2999fc75b1 PY3: use six.BytesIO and six.moves.cStringIO 2014-07-15 15:52:10 +08:00
Mikhail Korobov
91387b6e55 Merge pull request #801 from felixonmars/py3-port 
PY3: fix xmlrpclib and email imports
 2014-07-14 21:49:40 +06:00
Felix Yan
61717ca075 use six.moves version for MIMEMultipart, MIMEText, and MIMEBase 2014-07-14 23:08:40 +08:00
Felix Yan
0d758e4b30 PY3: fix xmlrpclib and email imports 2014-07-14 22:18:57 +08:00
Mikhail Korobov
5a2f738fac Merge pull request #800 from felixonmars/py3-port 
PY3: use six for robotparser and urlparse
 2014-07-14 19:46:10 +06:00
Felix Yan
6f7efa1d1d PY3: use six for robotparser and urlparse 2014-07-14 21:26:37 +08:00
Mikhail Korobov
2de4b8dc14 TST clean temporary file explicitly 2014-07-14 18:00:20 +06:00
Mikhail Korobov
321a76569d Merge pull request #799 from felixonmars/py3-port 
PY3: use six.iterkeys, six.iteritems, and tempfile
 2014-07-14 17:52:25 +06:00
Felix Yan
4f24e724a3 PY3: use six.iterkeys, six.iteritems, and tempfile 2014-07-14 18:47:22 +08:00
Mikhail Korobov
2f567f94a5 Merge pull request #798 from felixonmars/py3-port 
PY3: fix has_key and use six.moves.configparser
 2014-07-14 16:17:30 +06:00
Felix Yan
3067d6d710 PY3: fix has_key and use six.moves.configparser 2014-07-14 18:09:11 +08:00
Mikhail Korobov
2cddc2a379 Merge pull request #797 from felixonmars/py3-port 
PY3: use six.moves.cPickle
 2014-07-14 15:44:51 +06:00
Felix Yan
389882eb13 PY3: use six.moves.cPickle 2014-07-14 17:15:28 +08:00
Daniel Graña
e95e1fb79c Merge pull request #796 from redapple/patch-1 
Add PyPI Pin for Wheels compatibility
 2014-07-12 22:12:09 -03:00
Daniel Graña
0240ff8287 Merge pull request #791 from redapple/xhtmllinks 
Extract links from XHTML documents with MIME-Type "application/xml"
 2014-07-11 17:07:54 -03:00
Paul Tremberth
41ad55de20 Add PyPI Pin for Wheels compatibility 2014-07-11 21:53:10 +02:00
Mikhail Korobov
71685fa2d0 too much drama 2014-07-11 13:29:18 +06:00
Paul Tremberth
54d2b110f1 Extract links from XHTML documents with MIME-Type "application/xml" 
"application/xhtml+xml" is already interpreted as HTML
and link extractor is fine with it to extract links.

Only for XML documents can the namespaces in tags be an issue.

Fixes #780

Do both tag and attribute tests in _iter_links() method
 2014-07-10 23:50:48 +02:00
Roy Crihfield
1a950e8f5a Fix typo in commands.rst 2014-07-10 14:48:15 -03:00
Daniel Graña
ef8b3372df Merge pull request #792 from redapple/travis-release-cond 
Fix Travis CI config for conditional releases
 2014-07-10 14:41:30 -03:00
Paul Tremberth
6e04c0b388 Match dot using character class (avoids escaping headaches) 2014-07-10 14:54:08 +02:00