1
0
mirror of https://github.com/scrapy/scrapy.git synced 2025-02-26 21:24:01 +00:00

393 Commits

Author SHA1 Message Date
Mikhail Korobov
7f927f68e1 PY3 port scrapy.utils.response 2015-08-01 00:35:43 +05:00
Mikhail Korobov
d05cf6e0af Merge branch 'responsetypes' 2015-07-31 23:50:06 +05:00
Mikhail Korobov
02b5182608 small ResponseTypes cleanup 2015-07-31 23:48:49 +05:00
Daniel Graña
de6e013b9a fix form requests tests on py3 2015-07-31 14:54:07 -03:00
Daniel Graña
786f62664b Merge pull request #1137 from DharmeshPandav/patch-1
Update form.py to improve existing capability
2015-07-31 11:00:57 -03:00
Gregory Vigo Torres
06b91da943 using bytes for body constant 2015-07-31 14:31:11 +02:00
Gregory Vigo Torres
5d75d44f2c removed test_responsetypes from py3ignores 2015-07-30 13:07:42 +02:00
nyov
e044bfa60f PY3 fix test downloadermiddleware decompression 2015-07-29 13:51:01 +00:00
nyov
ec8afbc060 PY3 fix test pipeline media 2015-07-29 13:51:01 +00:00
nyov
8ab1648a36 PY3 fix test middleware 2015-07-29 13:51:01 +00:00
Mikhail Korobov
757f983a97 PY3: enable RobotsTxtMiddleware tests 2015-07-29 18:37:04 +05:00
nyov
1a1bc2c6b5 PY3 port scrapy.downloadermiddlewares.robotstxt.RobotsTxtMiddleware 2015-07-29 04:21:57 +00:00
Mikhail Korobov
c78e2636f9 TST a test to show that dupefilter persistence is not working 2015-07-28 14:31:42 +05:00
Daniel Graña
2c937f3554 PY3 port scrapy.dupefilters 2015-07-25 18:10:29 +02:00
Daniel Graña
776064aee1 PY3 port signals 2015-07-25 18:04:55 +02:00
Mikhail Korobov
c53d6d7460 Merge pull request #1383 from zoliszeredi/py3/fix_test_utils_defer
Py3/fix test utils defer
2015-07-25 17:43:50 +02:00
Mikhail Korobov
7874bb9f13 PY3 port utils.request 2015-07-25 17:14:56 +02:00
Daniel Graña
f750ee4c00 Remove ignored passing tests from py3 branch 2015-07-25 16:51:22 +02:00
Daniel Graña
ea56067e40 ignore moved files from py3 tests 2015-07-25 16:39:02 +02:00
Mikhail Korobov
e438df7028 PY3 enable Request and Response tests 2015-07-25 13:10:13 +02:00
Mikhail Korobov
e853d9e910 partial port of Request and Response 2015-07-25 13:08:44 +02:00
Zoltán Szeredi
1bf7a98000 Remove test_utils_defer from ignores. 2015-07-25 13:05:50 +02:00
Zoltán Szeredi
9aaa8f8125 Improve python3 support for test_utils_defer. 2015-07-25 12:58:39 +02:00
Mikhail Korobov
f576b3ffee [tmp] improve python 3 support for scrapy.utils.url 2015-07-25 00:40:45 +02:00
Mikhail Korobov
a7b4a3e7f9 cleanup
* run test_utils_python in Python 3;
* make tests for 'errors' argument more explicit
* add missing test_ prefix utf_16_strings_contain_null_bytes;
* cleanup test names.
2015-07-23 20:03:33 +02:00
Mikhail Korobov
4073498652 port utils.python
* stringify_dict is deprecated
* is_writable is deprecated
* setattr_default is deprecated
* get_spec is untested
* re_rsearch is untested
* retry_on_eintr is untested
2015-07-23 18:33:56 +02:00
Mikhail Korobov
41bcae5d00 TST fix to_bytes and to_unicode tests in Python 3.x 2015-07-23 17:35:23 +02:00
Mikhail Korobov
61cd27e5c7 Rename unicode_to_str and str_to_unicode method. Fixes GH-778. 2015-07-23 15:00:06 +02:00
Jakob de Maeyer
c153217bfb Fix RedirectMiddleware test 2015-07-17 16:11:53 +02:00
Jakob de Maeyer
c908d31660 Make RedirectMiddleware respect Spider.handle_httpstatus_list 2015-07-16 12:50:26 +02:00
nyov
4f56c6c79b Unset environment proxies for tests
because urllib doesn't handle $no_proxy correctly
and the unittest webserver is always local.
2015-07-11 11:30:08 +00:00
Julia Medina
d706310d8b Merge pull request #1151 from marven/cache-control
[MRG+1] RFC2616 policy enhancements + tests
2015-07-11 08:06:20 -03:00
Julia Medina
d3d61fde87 Fix a recent mock regression by not using it in a test 2015-07-10 19:58:38 -03:00
Demelziraptor
9a15fcf89a interpreting application/x-json as TextResponse 2015-07-02 19:56:30 +02:00
Daniel Graña
07f4f12e8b Merge pull request #1313 from eliasdorneles/support-empty-passwd-for-http-proxy
[MRG+1] Support empty password for http_proxy config
2015-06-30 19:58:16 -03:00
Mikhail Korobov
ea4b175c2d Merge pull request #1254 from scrapy/bugfix-1232
[MRG +1] Unquote request path before passing to FTPClient, it already escape paths
2015-06-24 18:04:45 +05:00
Elias Dorneles
eb8fed4ecd support empty password for http_proxy config 2015-06-23 00:43:15 -03:00
Berker Peksag
8a48d9c6a8 Ignore ScrapyDeprecationWarning warnings properly.
Conflicts:

	tests/test_utils_deprecate.py
2015-06-09 18:22:03 +03:00
Mikhail Korobov
d047665c02 make "settings" argument optional for Crawler, CrawlerRunner and CrawlerProcess 2015-06-06 03:23:13 +05:00
Mikhail Korobov
cc2f3e1b46 TST a test case to show custom_settings doesn't always work 2015-06-03 04:26:20 +05:00
Julia Medina
ffc7b7fd6c Add helper to update deprecated class paths 2015-06-01 17:01:33 -03:00
Marven Sanchez
bb3ebf13f9 Add tests for RFC2616 policy enhancements
Add `scrapy/downloadermiddlewares/httpcache.py` to `tests/py3-ignores.txt
2015-06-01 18:20:12 +08:00
Mikhail Korobov
aa6a72707d fixed CrawlerProcess when settings are passed as dicts
See https://github.com/scrapy/scrapy/pull/1156
2015-05-30 06:59:15 +05:00
Daniel Graña
ebe889a663 Unquote request path before passing to FTPClient, it already escape paths 2015-05-23 20:50:30 -03:00
Mikhail Korobov
cc2258b2bb Merge pull request #1145 from bosnj/master
[MRG+1] default return value for extract_first
2015-05-21 22:03:54 +05:00
Daniel Graña
ee59112480 Merge pull request #1224 from scrapy/fix-empty-feed-export-fields
[MRG] fixed FEED_EXPORT_FIELDS handling (see #1223)
2015-05-19 16:36:05 -03:00
Mikhail Korobov
7a5b5ec4d6 TST remove unnecessary lines from py3-ignores
scrapy/contrib is already skipped - see https://github.com/scrapy/scrapy/pull/1165
2015-05-19 00:57:39 +05:00
Mikhail Korobov
9b0ca1b7a0 drop support for FEED_EXPORT_FIELD=[] meaning "no fields" 2015-05-18 17:13:25 +05:00
Mikhail Korobov
9fb318338b support FEED_EXPORT_FIELDS=[] 2015-05-18 16:44:02 +05:00
Mikhail Korobov
e1efd19175 TST, DOC document that Scrapy only infers field names for CSV 2015-05-18 16:43:23 +05:00