Felix Yan
61717ca075
use six.moves version for MIMEMultipart, MIMEText, and MIMEBase
2014-07-14 23:08:40 +08:00
Felix Yan
0d758e4b30
PY3: fix xmlrpclib and email imports
2014-07-14 22:18:57 +08:00
Mikhail Korobov
5a2f738fac
Merge pull request #800 from felixonmars/py3-port
...
PY3: use six for robotparser and urlparse
2014-07-14 19:46:10 +06:00
Felix Yan
6f7efa1d1d
PY3: use six for robotparser and urlparse
2014-07-14 21:26:37 +08:00
Mikhail Korobov
2de4b8dc14
TST clean temporary file explicitly
2014-07-14 18:00:20 +06:00
Mikhail Korobov
321a76569d
Merge pull request #799 from felixonmars/py3-port
...
PY3: use six.iterkeys, six.iteritems, and tempfile
2014-07-14 17:52:25 +06:00
Felix Yan
4f24e724a3
PY3: use six.iterkeys, six.iteritems, and tempfile
2014-07-14 18:47:22 +08:00
Mikhail Korobov
2f567f94a5
Merge pull request #798 from felixonmars/py3-port
...
PY3: fix has_key and use six.moves.configparser
2014-07-14 16:17:30 +06:00
Felix Yan
3067d6d710
PY3: fix has_key and use six.moves.configparser
2014-07-14 18:09:11 +08:00
Mikhail Korobov
2cddc2a379
Merge pull request #797 from felixonmars/py3-port
...
PY3: use six.moves.cPickle
2014-07-14 15:44:51 +06:00
Felix Yan
389882eb13
PY3: use six.moves.cPickle
2014-07-14 17:15:28 +08:00
Daniel Graña
e95e1fb79c
Merge pull request #796 from redapple/patch-1
...
Add PyPI Pin for Wheels compatibility
2014-07-12 22:12:09 -03:00
Daniel Graña
0240ff8287
Merge pull request #791 from redapple/xhtmllinks
...
Extract links from XHTML documents with MIME-Type "application/xml"
2014-07-11 17:07:54 -03:00
Paul Tremberth
41ad55de20
Add PyPI Pin for Wheels compatibility
2014-07-11 21:53:10 +02:00
Alexander Chekunkov
a2dd5e5ad9
Added referer to "Spider error processing" log message + fixed some pep8 issues
2014-07-11 16:21:57 +03:00
Mikhail Korobov
71685fa2d0
too much drama
2014-07-11 13:29:18 +06:00
Paul Tremberth
54d2b110f1
Extract links from XHTML documents with MIME-Type "application/xml"
...
"application/xhtml+xml" is already interpreted as HTML
and link extractor is fine with it to extract links.
Only for XML documents can the namespaces in tags be an issue.
Fixes #780
Do both tag and attribute tests in _iter_links() method
2014-07-10 23:50:48 +02:00
Roy Crihfield
1a950e8f5a
Fix typo in commands.rst
2014-07-10 14:48:15 -03:00
Daniel Graña
ef8b3372df
Merge pull request #792 from redapple/travis-release-cond
...
Fix Travis CI config for conditional releases
2014-07-10 14:41:30 -03:00
Paul Tremberth
6e04c0b388
Match dot using character class (avoids escaping headaches)
2014-07-10 14:54:08 +02:00
Paul Tremberth
8d5c2fe30b
Fix Travis CI config for conditional releases
2014-07-10 13:44:32 +02:00
Daniel Graña
0fd119dfec
Bump version: 0.25.0 → 0.25.1
0.25.1
2014-07-09 03:05:39 -03:00
Daniel Graña
9b8e1836c8
deploy to pypi only on even minor version
2014-07-09 02:50:12 -03:00
Daniel Graña
ea8e444bd6
better testcase for settings.overrides.setdefault
2014-07-09 01:41:27 -03:00
Pablo Hoffman
4bb0989833
Merge pull request #787 from ivannotes/master
...
Using CRLF as line marker according to http 1.1 definition
2014-07-08 19:37:01 -03:00
Daniel Graña
379f6ee6b2
Add 0.24.2 release notes
2014-07-08 05:53:35 -03:00
Daniel Graña
acbde40fe7
Use a mutable mapping to proxy deprecated settings.overrides and settings.defaults attribute
2014-07-08 05:27:13 -03:00
ivan
a9c7f8b26d
Using CRLF as line marker according to http 1.1 definition
2014-07-08 14:37:44 +08:00
Mikhail Korobov
e29eec9c2a
Merge pull request #786 from zsiciarz/patch-1
...
Fixed Python syntax in tutorial.
2014-07-04 14:45:45 +06:00
Zbigniew Siciarz
0466e8cb7a
Fixed Python syntax in tutorial.
2014-07-04 10:38:01 +02:00
Mikhail Korobov
f3f3a440d3
fix a couple of typos in sep-19
2014-07-04 04:03:45 +06:00
Pablo Hoffman
19dc3fa053
fix typo
2014-07-03 17:54:21 -03:00
Mikhail Korobov
a653bf38be
Merge pull request #779 from Digenis/master
...
selector.__repr__ test
2014-07-03 20:31:15 +06:00
Nikolaos-Digenis Karagiannis
aacf1d05e1
selector.__repr__ test, unicode query
2014-07-03 13:11:25 +03:00
Nikolaos-Digenis Karagiannis
9ac639abd3
selector.__repr__ test, rename method
2014-07-03 13:10:55 +03:00
Nikolaos-Digenis Karagiannis
d2d014a4e9
selector.__repr__ test, repr type is bytesarray
2014-07-03 09:32:52 +03:00
Pablo Hoffman
36d99a0739
Merge pull request #777 from scrapy/deprecate-sgml
...
Deprecate SgmlLinkExtractor
2014-07-02 19:05:49 -03:00
Mikhail Korobov
19228c6584
Remove FixedSGMLParser: it is both useless and unused.
2014-07-03 03:59:28 +06:00
Mikhail Korobov
7316a37635
FixedSGMLParser is useless.
2014-07-03 01:32:33 +06:00
Pablo Hoffman
4b17aa222e
Merge pull request #776 from kmike/py3-tests-fix
...
PY3 make it possible to run some tests in Python3
2014-07-02 15:58:14 -03:00
Mikhail Korobov
00cd4f0fa5
deprecate SgmlLinkExtractor
2014-07-02 23:15:17 +06:00
Mikhail Korobov
2b749668ba
Deprecate scrapy.python.utils.FixedSGMLParser
...
SGML link extractor that uses it is also going to be deprecated;
sgmllib module is not available in Python 3.
2014-07-02 22:48:16 +06:00
Mikhail Korobov
e38e3d2752
PY3 make it possible to run some tests in Python3
...
* switch to Twisted 14.0.0 because SVN version broke twisted.log in Python 3;
* skip top-level shortcuts to make at least some tests pass;
* use PY3 compatible import of _monkeypatches.
2014-07-02 22:23:01 +06:00
Daniel Graña
e87dc37741
Merge pull request #775 from kmike/rename-sflo
...
rename "sflo" local variables to less cryptic "log_observer"
2014-07-02 11:49:23 -03:00
Nikolaos-Digenis Karagiannis
daabc718a9
selector.__repr__ test
2014-07-02 16:03:21 +03:00
Mikhail Korobov
9d3aa945f4
rename "sflo" local variables to less cryptic "log_observer"
2014-07-02 18:16:26 +06:00
Daniel Graña
e17866aaab
there is not support for python3 yet
2014-07-01 17:12:01 +00:00
Daniel Graña
e58c23e4a9
Update python compatible version set to debian packages
2014-07-01 12:12:31 -03:00
Mikhail Korobov
173a9dfe86
DOC fix formatting in release notes
2014-06-28 13:28:57 +06:00
Daniel Graña
284a2a06c9
Add 0.24.1 release notes
2014-06-27 12:03:37 -03:00