1
0
mirror of https://github.com/scrapy/scrapy.git synced 2025-02-22 20:24:14 +00:00

4271 Commits

Author SHA1 Message Date
Daniel Graña
4161a8c82c lint scrapy/http/request/*.py 2014-08-01 02:38:33 -03:00
Daniel Graña
ccae49813a PY3: port scrapy/utils/httpobj.py 2014-08-01 02:38:29 -03:00
Daniel Graña
c564334d00 PY3: port scrapy/utils/gz.py 2014-08-01 02:25:33 -03:00
Daniel Graña
910d0d36c1 PY3: port scrapy/utils/conf.py 2014-08-01 02:20:34 -03:00
Mikhail Korobov
40cc875d6d PY3 MimeTypes wants files in text mode.
See http://hg.python.org/cpython/file/2766320bdb10/Lib/mimetypes.py#l202

before: 455 failed, 248 passed, 10 skipped, 8 warnings, 55 error in 88.36 seconds
after:  466 failed, 253 passed, 12 skipped, 8 warnings, 49 error in 90.15 seconds
2014-08-01 03:28:05 +06:00
Daniel Graña
7cd271eb8e remove more references to runtests.sh 2014-07-31 17:30:45 -03:00
Daniel Graña
d89fc50d41 Merge pull request #830 from dangra/py3-tests
[WIP] Prevent Python 3 port regressions
2014-07-31 14:24:03 -03:00
Daniel Graña
70ee66ba0c Collect the list of packages not working on python3 2014-07-31 14:06:34 -03:00
Daniel Graña
6c402d3cc4 The sum up of travis-ci builds are taking like 50min to complete 2014-07-31 14:05:19 -03:00
Daniel Graña
8d1f267716 Merge pull request #827 from dangra/tests-on-root
Move Test cases under project root dir
2014-07-31 13:47:01 -03:00
Daniel Graña
99fb4eb12d fix requirements.txt for tests under precise 2014-07-31 12:50:07 -03:00
Daniel Graña
1a96cd5a3d update tox usage on contributing.rst 2014-07-31 12:28:35 -03:00
Daniel Graña
d63d55d96f remove obsolete shell scripts used to run tests suite 2014-07-31 12:28:35 -03:00
Daniel Graña
7a41ef417d Fix bench command 2014-07-31 12:28:35 -03:00
Daniel Graña
aaf531c7dc fix Twisted package name 2014-07-30 19:45:08 -03:00
Daniel Graña
eb1cf303d3 use pytest.ini to enable twisted plugin 2014-07-30 19:45:08 -03:00
Daniel Graña
caab9f29f2 move tests requirements under tests dir 2014-07-30 19:45:08 -03:00
Daniel Graña
242c08553f move tests under root dir 2014-07-30 19:45:08 -03:00
Daniel Graña
51feb4b620 Merge pull request #820 from lisimia/patch-1
Update shell.rst typo
2014-07-28 13:33:29 -03:00
Lisimia
b6b44a33f7 Update shell.rst typo
There was a typo. 
"start" was mistyped as "star"
2014-07-28 12:26:13 -04:00
Daniel Graña
8f4e63cda3 Merge branch 'py3-port' 2014-07-24 15:38:21 -03:00
Daniel Graña
0cf035dcbd Add tox env for python 3.4 2014-07-24 15:38:04 -03:00
Daniel Graña
79aba9e314 pytest 2.6.0 is on pypi now 2014-07-24 15:37:43 -03:00
Daniel Graña
6d215a1b34 items: Use BaseItem.__hash__ and six.add_metaclass decorator 2014-07-24 15:37:10 -03:00
Felix Yan
dbc9b37365 PY3: use MutableMapping instead of DictMixin 2014-07-25 00:34:01 +08:00
Mikhail Korobov
d7d9f2f96d Merge pull request #814 from eliasdorneles/adding-some-xpath-tips
Adding some xpath tips to selectors docs
2014-07-24 08:04:05 +06:00
Elias Dorneles
c298eaf164 removes weird indentation in the shell results 2014-07-23 20:42:36 -03:00
Elias Dorneles
514e8582d0 improved explanations, clarified blog post as source, added link for XPath string functions in the spec 2014-07-23 19:43:57 -03:00
Daniel Graña
16ed92d75c Merge pull request #815 from nramirezuy/retry_timeout-583
renamed UserTimeoutError and ServerTimeouterror #583
2014-07-23 18:28:43 -03:00
nramirezuy
ebf76867bd renamed UserTimeoutError and ServerTimeouterror #583 2014-07-23 18:11:12 -03:00
Elias Dorneles
80de43ddab adding some xpath tips to selectors docs 2014-07-22 23:20:53 -03:00
Pablo Hoffman
4cf6a3b4b3 Merge pull request #812 from kmike/fix-w3lib-trunk
fix tests to account for https://github.com/scrapy/w3lib/pull/23
2014-07-22 15:54:42 -03:00
Mikhail Korobov
af0635e229 fix tests to account for https://github.com/scrapy/w3lib/pull/23 2014-07-22 04:15:13 +06:00
Daniel Graña
f6b1e9b7c2 Merge pull request #803 from felixonmars/py3-port
[MRG] PY3: use six.BytesIO and six.moves.cStringIO
2014-07-21 14:17:42 -03:00
Daniel Graña
dd3b77ea2e Merge pull request #809 from nramirezuy/get_func_args-728
get_func_args maximum recursion fix #728
2014-07-21 13:41:03 -03:00
nramirezuy
86f61a9906 get_func_args maximum recursion fix #728 2014-07-21 13:12:59 -03:00
Pablo Hoffman
e748ca50ca Merge pull request #804 from darkrho/issue-560
Updated input/ouput processor example according to #560.
hojo
2014-07-16 17:14:53 -03:00
Pablo Hoffman
a17d417281 Merge pull request #805 from darkrho/spiderstate-jobdir
For consistency, use `job_dir` helper in `SpiderState` extension.
2014-07-16 17:11:20 -03:00
Rolando Espinoza
85b52b0654 For consistency, use job_dir helper in SpiderState extension.
The `SpiderState` extension is the only place not using the `job_dir`
helper.

This might cause an error in case JOBDIR is a nested path which does not
exists, although this is least likely by default given the job dir being
set up earlier.
2014-07-16 10:34:42 -04:00
Rolando Espinoza
e441a01818 Updated input/ouput processor example according to #560. 2014-07-16 09:04:48 -04:00
Felix Yan
1cd9c4d653 fix tests by using a tempfile instead of BytesIO 2014-07-15 21:26:01 +08:00
Felix Yan
0786e84a33 use io.BytesIO and cStringIO instead of six.BytesIO as suggested 2014-07-15 20:51:12 +08:00
Felix Yan
ef8872a518 use .seek(0) instead of reset() for compatibility
Since I don't find docs for the .reset() method, I lookup up the source
code, and it should work just the same as .seek(0).

For reference:
8eeb7e9122/Modules/cStringIO.c (L281)
2014-07-15 16:24:57 +08:00
Felix Yan
2999fc75b1 PY3: use six.BytesIO and six.moves.cStringIO 2014-07-15 15:52:10 +08:00
Mikhail Korobov
91387b6e55 Merge pull request #801 from felixonmars/py3-port
PY3: fix xmlrpclib and email imports
2014-07-14 21:49:40 +06:00
Felix Yan
61717ca075 use six.moves version for MIMEMultipart, MIMEText, and MIMEBase 2014-07-14 23:08:40 +08:00
Felix Yan
0d758e4b30 PY3: fix xmlrpclib and email imports 2014-07-14 22:18:57 +08:00
Mikhail Korobov
5a2f738fac Merge pull request #800 from felixonmars/py3-port
PY3: use six for robotparser and urlparse
2014-07-14 19:46:10 +06:00
Felix Yan
6f7efa1d1d PY3: use six for robotparser and urlparse 2014-07-14 21:26:37 +08:00
Mikhail Korobov
2de4b8dc14 TST clean temporary file explicitly 2014-07-14 18:00:20 +06:00