nyov
ec8afbc060
PY3 fix test pipeline media
2015-07-29 13:51:01 +00:00
nyov
8ab1648a36
PY3 fix test middleware
2015-07-29 13:51:01 +00:00
nyov
683ef2a8d9
replace rfc822 with email.utils
2015-07-29 13:51:01 +00:00
Mikhail Korobov
757f983a97
PY3: enable RobotsTxtMiddleware tests
2015-07-29 18:37:04 +05:00
Mikhail Korobov
56fa9e2c1c
Merge pull request #1391 from nyov/py3-robots
...
PY3 port scrapy.downloadermiddlewares.robotstxt.RobotsTxtMiddleware
2015-07-29 18:21:54 +05:00
nyov
1a1bc2c6b5
PY3 port scrapy.downloadermiddlewares.robotstxt.RobotsTxtMiddleware
2015-07-29 04:21:57 +00:00
Mikhail Korobov
836cb84b7a
fixed RFPDupeFilter persistence
2015-07-28 14:32:14 +05:00
Mikhail Korobov
c78e2636f9
TST a test to show that dupefilter persistence is not working
2015-07-28 14:31:42 +05:00
Daniel Graña
2c937f3554
PY3 port scrapy.dupefilters
2015-07-25 18:10:29 +02:00
Daniel Graña
776064aee1
PY3 port signals
2015-07-25 18:04:55 +02:00
Mikhail Korobov
82304c4fae
PY3: fixed scrapy.utils.defer
2015-07-25 17:48:34 +02:00
Mikhail Korobov
c53d6d7460
Merge pull request #1383 from zoliszeredi/py3/fix_test_utils_defer
...
Py3/fix test utils defer
2015-07-25 17:43:50 +02:00
Mikhail Korobov
7874bb9f13
PY3 port utils.request
2015-07-25 17:14:56 +02:00
Daniel Graña
f750ee4c00
Remove ignored passing tests from py3 branch
2015-07-25 16:51:22 +02:00
Daniel Graña
ea56067e40
ignore moved files from py3 tests
2015-07-25 16:39:02 +02:00
Mikhail Korobov
e438df7028
PY3 enable Request and Response tests
2015-07-25 13:10:13 +02:00
Mikhail Korobov
e853d9e910
partial port of Request and Response
2015-07-25 13:08:44 +02:00
Zoltán Szeredi
1bf7a98000
Remove test_utils_defer from ignores.
2015-07-25 13:05:50 +02:00
Zoltán Szeredi
9aaa8f8125
Improve python3 support for test_utils_defer.
2015-07-25 12:58:39 +02:00
Julia Medina
9d9d4238aa
Merge pull request #1380 from nyov/contributing
...
Put a blurb about support channels in CONTRIBUTING
2015-07-24 21:30:14 -03:00
Mikhail Korobov
f576b3ffee
[tmp] improve python 3 support for scrapy.utils.url
2015-07-25 00:40:45 +02:00
Mikhail Korobov
335aa5f276
Merge pull request #1379 from scrapy/py3-utils-python
...
PY3 port scrapy.utils.python
2015-07-24 12:17:16 +02:00
nyov
b3dda1e9c5
Put a blurb about support channels in CONTRIBUTING
2015-07-24 01:48:43 +00:00
Mikhail Korobov
a7b4a3e7f9
cleanup
...
* run test_utils_python in Python 3;
* make tests for 'errors' argument more explicit
* add missing test_ prefix utf_16_strings_contain_null_bytes;
* cleanup test names.
2015-07-23 20:03:33 +02:00
Mikhail Korobov
4073498652
port utils.python
...
* stringify_dict is deprecated
* is_writable is deprecated
* setattr_default is deprecated
* get_spec is untested
* re_rsearch is untested
* retry_on_eintr is untested
2015-07-23 18:33:56 +02:00
Mikhail Korobov
41bcae5d00
TST fix to_bytes and to_unicode tests in Python 3.x
2015-07-23 17:35:23 +02:00
Mikhail Korobov
887936ebf6
PY3 port flatten and iflatten
2015-07-23 17:26:20 +02:00
Mikhail Korobov
61cd27e5c7
Rename unicode_to_str and str_to_unicode method. Fixes GH-778.
2015-07-23 15:00:06 +02:00
Mikhail Korobov
f93acffff4
Merge pull request #1366 from radarhere/patch-1
...
Fixed typos
2015-07-18 22:16:28 +05:00
Jakob de Maeyer
c153217bfb
Fix RedirectMiddleware test
2015-07-17 16:11:53 +02:00
Andrew Murray
198be7d679
Fixed typos
2015-07-16 23:59:02 +10:00
Jakob de Maeyer
c908d31660
Make RedirectMiddleware respect Spider.handle_httpstatus_list
2015-07-16 12:50:26 +02:00
nyov
4f56c6c79b
Unset environment proxies for tests
...
because urllib doesn't handle $no_proxy correctly
and the unittest webserver is always local.
2015-07-11 11:30:08 +00:00
Julia Medina
d706310d8b
Merge pull request #1151 from marven/cache-control
...
[MRG+1] RFC2616 policy enhancements + tests
2015-07-11 08:06:20 -03:00
Julia Medina
6ac971ebac
Merge pull request #1351 from scrapy/fix-regression-in-mock
...
Fix a recent mock regression by not using it in a test
2015-07-10 20:08:25 -03:00
Julia Medina
d3d61fde87
Fix a recent mock regression by not using it in a test
2015-07-10 19:58:38 -03:00
Julia Medina
306b028ab3
Merge pull request #1348 from nzp/tutorial-ref-fix
...
Fix reference in tutorial.
2015-07-09 23:17:53 -03:00
Nikola Pavlović
7bef61dbbd
Fix reference.
2015-07-10 02:35:27 +02:00
Jakob de Maeyer
d438075a47
Make Sphinx autodoc use local, not system-wide Scrapy
2015-07-03 16:51:53 +02:00
Julia Medina
8b3ca4f250
Merge pull request #1302 from eliasdorneles/improving-access-settings-docs
...
[MRG+1] Improvements for docs on how to access settings
2015-07-03 00:56:32 -03:00
Daniel Graña
2a7dc31f4c
Merge pull request #1333 from demelziraptor/x-json-response
...
interpreting application/x-json as TextResponse
2015-07-02 15:20:47 -03:00
Demelziraptor
9a15fcf89a
interpreting application/x-json as TextResponse
2015-07-02 19:56:30 +02:00
Daniel Graña
3fc4e0b319
Merge pull request #1282 from otherchirps/memusage-check-interval
...
[MRG+1] Added MEMUSAGE_CHECK_INTERVAL_SECONDS to Memory usage extension options.
2015-07-02 13:50:55 -03:00
Daniel Graña
6fa3f2421c
Add 1.0.1 release notes
2015-07-01 01:49:44 -03:00
Daniel Graña
07f4f12e8b
Merge pull request #1313 from eliasdorneles/support-empty-passwd-for-http-proxy
...
[MRG+1] Support empty password for http_proxy config
2015-06-30 19:58:16 -03:00
Daniel Graña
98707e15f6
Merge pull request #1324 from scrapy/autothrottle
...
Autothrottle enhancements
2015-06-26 22:26:06 -03:00
Mikhail Korobov
d850238c22
add AUTOTHROTTLE_TARGET_CONCURRENCY option and expand AutoThrottle docs
2015-06-27 04:59:42 +05:00
Mikhail Korobov
63317531f9
DOC fix authrottle docs
...
see https://github.com/scrapy/scrapy/pull/502/files#r8574692
2015-06-26 20:47:58 +05:00
Mikhail Korobov
1fef9f1132
AutoThrottle: respect download_delay=0 spider attribute
2015-06-26 19:09:26 +05:00
Mikhail Korobov
17cb51315b
drop support for AUTOTHROTTLE_MIN_DOWNLOAD_DELAY
...
it was deprecated for years
2015-06-26 19:07:54 +05:00
