1
0
mirror of https://github.com/scrapy/scrapy.git synced 2025-02-26 10:23:41 +00:00

5189 Commits

Author SHA1 Message Date
Elias Dorneles
8ef5aa2ffc using bytes for response body in tests 2015-08-11 14:09:34 -03:00
Elias Dorneles
3a03ef7c08 cleanup tests for selectors and translators 2015-08-11 14:09:34 -03:00
Elias Dorneles
12579b9afa warning when ambiguous root arguments and minor cleanups 2015-08-11 14:09:34 -03:00
Elias Dorneles
26ebccd37a upgrade parsel and use its function to instantiate root for finding form 2015-08-11 14:09:34 -03:00
Elias Dorneles
2fe6d128f5 upgrade parsel and using promoted root attribute 2015-08-11 14:09:16 -03:00
Elias Dorneles
67c98b185b avoid harcoded check for selector type 2015-08-11 14:09:00 -03:00
Elias Dorneles
94c3a345b7 remove deprecated module lxmldocument 2015-08-11 14:09:00 -03:00
Elias Dorneles
6287fc3109 remove lxmldocument dependency from http.request.form 2015-08-11 14:09:00 -03:00
Elias Dorneles
35c1dcdbc2 use response.selector in link extractors instead of instantiating new Selector 2015-08-11 14:09:00 -03:00
Elias Dorneles
17d7347a36 update minimal parsel version, add deprecated classes for csstranslator modules, fix test 2015-08-11 14:09:00 -03:00
Elias Dorneles
01d948f0fd remove selector support for LxmlDocument DOM cache and add deprecation warning for _root argument 2015-08-11 14:08:43 -03:00
Elias Dorneles
3a572e2f3b cleanup csstranslator module, keeping only imports 2015-08-11 14:08:43 -03:00
Elias Dorneles
c7b29d118d fix support to legacy _root argument 2015-08-11 14:08:43 -03:00
Elias Dorneles
ce21884a97 migrating scrapy Selector to use Parsel 2015-08-11 14:08:43 -03:00
Daniel Graña
f67a808d9e Add 1.0.3 release notes 2015-08-11 13:49:49 -03:00
Daniel Graña
342c29af5d Merge pull request #1425 from scrapy/service-identity
add service_identity to scrapy install_requires. Fix GH-1418 and GH-850.
2015-08-11 13:34:36 -03:00
Mikhail Korobov
75d3d03382 add service_identity to scrapy install_requires 2015-08-11 20:14:22 +05:00
Mikhail Korobov
fa123b335b Merge pull request #1421 from dangra/nyov/lazyload-downloadhandlers
lazy-load downloadhandlers (continuation of #1357)
2015-08-11 18:59:47 +05:00
Daniel Graña
7717501ab2 Use log formatting and pass crawler reference 2015-08-11 10:38:31 -03:00
Mikhail Korobov
fa3d84b050 Merge pull request #1420 from scrapy/py3-trackrefs
PY3: port scrapy.utils.trackref
2015-08-11 18:21:34 +05:00
Daniel Graña
8738521d0a Add docstrings 2015-08-10 19:35:57 -03:00
Daniel Graña
eb44152a58 lints 2015-08-10 18:25:11 -03:00
Daniel Graña
15ccf79cad Log errors importing or initializing download handlers 2015-08-10 18:18:13 -03:00
Daniel Graña
d3804b3439 log errors importing or instanciating handlers 2015-08-10 16:52:44 -03:00
nyov
8c7997083f lazy-loading for DownloadHandlers 2015-08-10 16:52:44 -03:00
Daniel Graña
666ebfa1d9 py3: port dictionary itervalues call 2015-08-10 16:45:27 -03:00
Mikhail Korobov
bdcc78b4dd Merge pull request #1419 from scrapy/httprepr-on-file-scheme
Do not fail representing non-http requests
2015-08-11 00:37:00 +05:00
Daniel Graña
accd28cc71 PY3: port scrapy.utils.trackref 2015-08-10 15:13:29 -03:00
Daniel Graña
8d45b3c481 Do not fail representing non-http requests 2015-08-10 14:10:58 -03:00
Daniel Graña
5c4666a3d4 Workaround for travis#253 2015-08-10 11:17:20 -03:00
Daniel Graña
1b9b211192 Merge pull request #1415 from scrapy/nyov-py3
nyov's PY3 changes
2015-08-08 12:23:44 -03:00
Mikhail Korobov
93accb7fb3 PY3 nicer log messages in FilesPipeline 2015-08-08 05:20:48 +05:00
Mikhail Korobov
56be610e6e TST a test for --profile option 2015-08-08 04:54:47 +05:00
nyov
17b5e9fb86 PY3 response bodies as bytes 2015-08-08 04:23:32 +05:00
nyov
45d441d444 PY3 fix test loader 2015-08-08 04:23:16 +05:00
nyov
34eced0ee8 PY3 fix tests pipelines images 2015-08-08 04:23:06 +05:00
nyov
991197003b PY3 fix tests pipelines files 2015-08-08 04:22:58 +05:00
nyov
6e762ce25c PY3 renames (six types) 2015-08-08 04:21:58 +05:00
nyov
3e6d6c43ac PY3 fix test cmdline 2015-08-08 04:19:55 +05:00
nyov
4d41cc0dc4 PY3 split requirements into files 2015-08-08 04:19:37 +05:00
Daniel Graña
57fafc702d Add 1.0.2 release notes 2015-08-06 18:02:12 -03:00
Mikhail Korobov
ad99a552a7 Merge pull request #1414 from scrapy/twisted-bug-7989-2
Twisted 15.3.0 does not raises expected exception serializing lambdas
2015-08-07 01:22:17 +05:00
Daniel Graña
c5ffa1a59f Twisted 15.3.0 does not raises expected exception serializing lambda functions 2015-08-06 16:40:21 -03:00
Mikhail Korobov
2bca27ef2c Merge pull request #1412 from mlyundin/master
Minor method name fix
2015-08-06 00:54:42 +05:00
Mikhail Lyundin
ea4199f8e1 Minor method name fix 2015-08-05 22:42:53 +03:00
Daniel Graña
311293ffdc Merge pull request #1408 from scrapy/py3-utils-reqser
PY3 port scrapy.utils.reqser
2015-08-03 20:09:14 -03:00
Mikhail Korobov
91991e0bdc PY port scrapy.utils.reqser 2015-08-04 02:17:46 +05:00
Mikhail Korobov
95e6bd2f8d Merge pull request #1398 from scrapy/py3-cookies
PY3 port http cookies handling
2015-08-04 01:23:37 +05:00
Daniel Graña
f4fc05c2a1 Do not propagate cookie log messages in tests so TopLevelFormatter does not rewrite them 2015-08-03 17:18:08 -03:00
Daniel Graña
c6adf648dc PY3 port COOKIES_DEBUG and add tests 2015-08-03 16:28:29 -03:00