1
0
mirror of https://github.com/scrapy/scrapy.git synced 2025-03-01 19:27:27 +00:00

4677 Commits

Author SHA1 Message Date
Felix Yan
61717ca075 use six.moves version for MIMEMultipart, MIMEText, and MIMEBase 2014-07-14 23:08:40 +08:00
Felix Yan
0d758e4b30 PY3: fix xmlrpclib and email imports 2014-07-14 22:18:57 +08:00
Mikhail Korobov
5a2f738fac Merge pull request #800 from felixonmars/py3-port
PY3: use six for robotparser and urlparse
2014-07-14 19:46:10 +06:00
Felix Yan
6f7efa1d1d PY3: use six for robotparser and urlparse 2014-07-14 21:26:37 +08:00
Mikhail Korobov
2de4b8dc14 TST clean temporary file explicitly 2014-07-14 18:00:20 +06:00
Mikhail Korobov
321a76569d Merge pull request #799 from felixonmars/py3-port
PY3: use six.iterkeys, six.iteritems, and tempfile
2014-07-14 17:52:25 +06:00
Felix Yan
4f24e724a3 PY3: use six.iterkeys, six.iteritems, and tempfile 2014-07-14 18:47:22 +08:00
Mikhail Korobov
2f567f94a5 Merge pull request #798 from felixonmars/py3-port
PY3: fix has_key and use six.moves.configparser
2014-07-14 16:17:30 +06:00
Felix Yan
3067d6d710 PY3: fix has_key and use six.moves.configparser 2014-07-14 18:09:11 +08:00
Mikhail Korobov
2cddc2a379 Merge pull request #797 from felixonmars/py3-port
PY3: use six.moves.cPickle
2014-07-14 15:44:51 +06:00
Felix Yan
389882eb13 PY3: use six.moves.cPickle 2014-07-14 17:15:28 +08:00
Daniel Graña
e95e1fb79c Merge pull request #796 from redapple/patch-1
Add PyPI Pin for Wheels compatibility
2014-07-12 22:12:09 -03:00
Daniel Graña
0240ff8287 Merge pull request #791 from redapple/xhtmllinks
Extract links from XHTML documents with MIME-Type "application/xml"
2014-07-11 17:07:54 -03:00
Paul Tremberth
41ad55de20 Add PyPI Pin for Wheels compatibility 2014-07-11 21:53:10 +02:00
Alexander Chekunkov
a2dd5e5ad9 Added referer to "Spider error processing" log message + fixed some pep8 issues 2014-07-11 16:21:57 +03:00
Mikhail Korobov
71685fa2d0 too much drama 2014-07-11 13:29:18 +06:00
Paul Tremberth
54d2b110f1 Extract links from XHTML documents with MIME-Type "application/xml"
"application/xhtml+xml" is already interpreted as HTML
and link extractor is fine with it to extract links.

Only for XML documents can the namespaces in tags be an issue.

Fixes #780

Do both tag and attribute tests in _iter_links() method
2014-07-10 23:50:48 +02:00
Roy Crihfield
1a950e8f5a Fix typo in commands.rst 2014-07-10 14:48:15 -03:00
Daniel Graña
ef8b3372df Merge pull request #792 from redapple/travis-release-cond
Fix Travis CI config for conditional releases
2014-07-10 14:41:30 -03:00
Paul Tremberth
6e04c0b388 Match dot using character class (avoids escaping headaches) 2014-07-10 14:54:08 +02:00
Paul Tremberth
8d5c2fe30b Fix Travis CI config for conditional releases 2014-07-10 13:44:32 +02:00
Daniel Graña
0fd119dfec Bump version: 0.25.0 → 0.25.1 0.25.1 2014-07-09 03:05:39 -03:00
Daniel Graña
9b8e1836c8 deploy to pypi only on even minor version 2014-07-09 02:50:12 -03:00
Daniel Graña
ea8e444bd6 better testcase for settings.overrides.setdefault 2014-07-09 01:41:27 -03:00
Pablo Hoffman
4bb0989833 Merge pull request #787 from ivannotes/master
Using CRLF as line marker according to http 1.1 definition
2014-07-08 19:37:01 -03:00
Daniel Graña
379f6ee6b2 Add 0.24.2 release notes 2014-07-08 05:53:35 -03:00
Daniel Graña
acbde40fe7 Use a mutable mapping to proxy deprecated settings.overrides and settings.defaults attribute 2014-07-08 05:27:13 -03:00
ivan
a9c7f8b26d Using CRLF as line marker according to http 1.1 definition 2014-07-08 14:37:44 +08:00
Mikhail Korobov
e29eec9c2a Merge pull request #786 from zsiciarz/patch-1
Fixed Python syntax in tutorial.
2014-07-04 14:45:45 +06:00
Zbigniew Siciarz
0466e8cb7a Fixed Python syntax in tutorial. 2014-07-04 10:38:01 +02:00
Mikhail Korobov
f3f3a440d3 fix a couple of typos in sep-19 2014-07-04 04:03:45 +06:00
Pablo Hoffman
19dc3fa053 fix typo 2014-07-03 17:54:21 -03:00
Mikhail Korobov
a653bf38be Merge pull request #779 from Digenis/master
selector.__repr__ test
2014-07-03 20:31:15 +06:00
Nikolaos-Digenis Karagiannis
aacf1d05e1 selector.__repr__ test, unicode query 2014-07-03 13:11:25 +03:00
Nikolaos-Digenis Karagiannis
9ac639abd3 selector.__repr__ test, rename method 2014-07-03 13:10:55 +03:00
Nikolaos-Digenis Karagiannis
d2d014a4e9 selector.__repr__ test, repr type is bytesarray 2014-07-03 09:32:52 +03:00
Pablo Hoffman
36d99a0739 Merge pull request #777 from scrapy/deprecate-sgml
Deprecate SgmlLinkExtractor
2014-07-02 19:05:49 -03:00
Mikhail Korobov
19228c6584 Remove FixedSGMLParser: it is both useless and unused. 2014-07-03 03:59:28 +06:00
Mikhail Korobov
7316a37635 FixedSGMLParser is useless. 2014-07-03 01:32:33 +06:00
Pablo Hoffman
4b17aa222e Merge pull request #776 from kmike/py3-tests-fix
PY3 make it possible to run some tests in Python3
2014-07-02 15:58:14 -03:00
Mikhail Korobov
00cd4f0fa5 deprecate SgmlLinkExtractor 2014-07-02 23:15:17 +06:00
Mikhail Korobov
2b749668ba Deprecate scrapy.python.utils.FixedSGMLParser
SGML link extractor that uses it is also going to be deprecated;
sgmllib module is not available in Python 3.
2014-07-02 22:48:16 +06:00
Mikhail Korobov
e38e3d2752 PY3 make it possible to run some tests in Python3
* switch to Twisted 14.0.0 because SVN version broke twisted.log in Python 3;
* skip top-level shortcuts to make at least some tests pass;
* use PY3 compatible import of _monkeypatches.
2014-07-02 22:23:01 +06:00
Daniel Graña
e87dc37741 Merge pull request #775 from kmike/rename-sflo
rename "sflo" local variables to less cryptic "log_observer"
2014-07-02 11:49:23 -03:00
Nikolaos-Digenis Karagiannis
daabc718a9 selector.__repr__ test 2014-07-02 16:03:21 +03:00
Mikhail Korobov
9d3aa945f4 rename "sflo" local variables to less cryptic "log_observer" 2014-07-02 18:16:26 +06:00
Daniel Graña
e17866aaab there is not support for python3 yet 2014-07-01 17:12:01 +00:00
Daniel Graña
e58c23e4a9 Update python compatible version set to debian packages 2014-07-01 12:12:31 -03:00
Mikhail Korobov
173a9dfe86 DOC fix formatting in release notes 2014-06-28 13:28:57 +06:00
Daniel Graña
284a2a06c9 Add 0.24.1 release notes 2014-06-27 12:03:37 -03:00