BackTrackZ/scrapy
BackTrackZ/scrapy
1
0
Fork 0
mirror of https://github.com/scrapy/scrapy.git synced 2025-02-26 21:04:34 +00:00
Code Releases Wiki Activity
4,938 Commits 39 Branches 119 Tags
Commit Graph

4938 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Mikhail Korobov
7874bb9f13 PY3 port utils.request 2015-07-25 17:14:56 +02:00
Daniel Graña
f750ee4c00 Remove ignored passing tests from py3 branch 2015-07-25 16:51:22 +02:00
Daniel Graña
ea56067e40 ignore moved files from py3 tests 2015-07-25 16:39:02 +02:00
Mikhail Korobov
e438df7028 PY3 enable Request and Response tests 2015-07-25 13:10:13 +02:00
Mikhail Korobov
e853d9e910 partial port of Request and Response 2015-07-25 13:08:44 +02:00
Zoltán Szeredi
1bf7a98000 Remove test_utils_defer from ignores. 2015-07-25 13:05:50 +02:00
Zoltán Szeredi
9aaa8f8125 Improve python3 support for test_utils_defer. 2015-07-25 12:58:39 +02:00
Julia Medina
9d9d4238aa Merge pull request #1380 from nyov/contributing 
Put a blurb about support channels in CONTRIBUTING
 2015-07-24 21:30:14 -03:00
Mikhail Korobov
f576b3ffee [tmp] improve python 3 support for scrapy.utils.url 2015-07-25 00:40:45 +02:00
Mikhail Korobov
335aa5f276 Merge pull request #1379 from scrapy/py3-utils-python 
PY3 port scrapy.utils.python
 2015-07-24 12:17:16 +02:00
nyov
b3dda1e9c5 Put a blurb about support channels in CONTRIBUTING 2015-07-24 01:48:43 +00:00
Mikhail Korobov
a7b4a3e7f9 cleanup 
* run test_utils_python in Python 3;
* make tests for 'errors' argument more explicit
* add missing test_ prefix utf_16_strings_contain_null_bytes;
* cleanup test names.
 2015-07-23 20:03:33 +02:00
Mikhail Korobov
4073498652 port utils.python 
* stringify_dict is deprecated
* is_writable is deprecated
* setattr_default is deprecated
* get_spec is untested
* re_rsearch is untested
* retry_on_eintr is untested
 2015-07-23 18:33:56 +02:00
Mikhail Korobov
41bcae5d00 TST fix to_bytes and to_unicode tests in Python 3.x 2015-07-23 17:35:23 +02:00
Mikhail Korobov
887936ebf6 PY3 port flatten and iflatten 2015-07-23 17:26:20 +02:00
Mikhail Korobov
61cd27e5c7 Rename unicode_to_str and str_to_unicode method. Fixes GH-778. 2015-07-23 15:00:06 +02:00
Mikhail Korobov
f93acffff4 Merge pull request #1366 from radarhere/patch-1 
Fixed typos
 2015-07-18 22:16:28 +05:00
Jakob de Maeyer
c153217bfb Fix RedirectMiddleware test 2015-07-17 16:11:53 +02:00
Andrew Murray
198be7d679 Fixed typos 2015-07-16 23:59:02 +10:00
Jakob de Maeyer
c908d31660 Make RedirectMiddleware respect Spider.handle_httpstatus_list 2015-07-16 12:50:26 +02:00
nyov
4f56c6c79b Unset environment proxies for tests 
because urllib doesn't handle $no_proxy correctly
and the unittest webserver is always local.
 2015-07-11 11:30:08 +00:00
Julia Medina
d706310d8b Merge pull request #1151 from marven/cache-control 
[MRG+1] RFC2616 policy enhancements + tests
 2015-07-11 08:06:20 -03:00
Julia Medina
6ac971ebac Merge pull request #1351 from scrapy/fix-regression-in-mock 
Fix a recent mock regression by not using it in a test
 2015-07-10 20:08:25 -03:00
Julia Medina
d3d61fde87 Fix a recent mock regression by not using it in a test 2015-07-10 19:58:38 -03:00
Julia Medina
306b028ab3 Merge pull request #1348 from nzp/tutorial-ref-fix 
Fix reference in tutorial.
 2015-07-09 23:17:53 -03:00
Nikola Pavlović
7bef61dbbd Fix reference. 2015-07-10 02:35:27 +02:00
Jakob de Maeyer
d438075a47 Make Sphinx autodoc use local, not system-wide Scrapy 2015-07-03 16:51:53 +02:00
Julia Medina
8b3ca4f250 Merge pull request #1302 from eliasdorneles/improving-access-settings-docs 
[MRG+1] Improvements for docs on how to access settings
 2015-07-03 00:56:32 -03:00
Daniel Graña
2a7dc31f4c Merge pull request #1333 from demelziraptor/x-json-response 
interpreting application/x-json as TextResponse
 2015-07-02 15:20:47 -03:00
Demelziraptor
9a15fcf89a interpreting application/x-json as TextResponse 2015-07-02 19:56:30 +02:00
Daniel Graña
3fc4e0b319 Merge pull request #1282 from otherchirps/memusage-check-interval 
[MRG+1] Added MEMUSAGE_CHECK_INTERVAL_SECONDS to Memory usage extension options.
 2015-07-02 13:50:55 -03:00
Daniel Graña
6fa3f2421c Add 1.0.1 release notes 2015-07-01 01:49:44 -03:00
Daniel Graña
07f4f12e8b Merge pull request #1313 from eliasdorneles/support-empty-passwd-for-http-proxy 
[MRG+1] Support empty password for http_proxy config
 2015-06-30 19:58:16 -03:00
Daniel Graña
98707e15f6 Merge pull request #1324 from scrapy/autothrottle 
Autothrottle enhancements
 2015-06-26 22:26:06 -03:00
Mikhail Korobov
d850238c22 add AUTOTHROTTLE_TARGET_CONCURRENCY option and expand AutoThrottle docs 2015-06-27 04:59:42 +05:00
Mikhail Korobov
63317531f9 DOC fix authrottle docs 
see https://github.com/scrapy/scrapy/pull/502/files#r8574692
 2015-06-26 20:47:58 +05:00
Mikhail Korobov
1fef9f1132 AutoThrottle: respect download_delay=0 spider attribute 2015-06-26 19:09:26 +05:00
Mikhail Korobov
17cb51315b drop support for AUTOTHROTTLE_MIN_DOWNLOAD_DELAY 
it was deprecated for years
 2015-06-26 19:07:54 +05:00
Mikhail Korobov
584252e8f2 move AutoThrottle default options to default_settings.py 2015-06-26 18:58:29 +05:00
Mikhail Korobov
e6272e5209 make AutoThrottle._adjust_delay easier to understand 2015-06-26 18:44:23 +05:00
Daniel Graña
7c98855927 Merge pull request #1321 from yarikoptic/upstream-master 
ENH: include tests/ to source distribution in MANIFEST.in
 2015-06-26 00:32:02 -03:00
Daniel Graña
5bcda9b7d1 Merge pull request #1290 from scrapy/crawler-runner-cleanup 
extract CrawlerRunner._crawl method which always expects Crawler
 2015-06-26 00:21:23 -03:00
Yaroslav Halchenko
5207d44055 ENH: include tests/ to source distribution in MANIFEST.in 2015-06-25 23:00:00 -04:00
Daniel Graña
148fb14040 Merge pull request #1319 from yarikoptic/fix-fail-if-docsbuild-fails 
[MRG+1] BF: fail if docs failed to build
 2015-06-25 23:35:42 -03:00
Yaroslav Halchenko
5f3e1e9a16 ENH: make explicit build-ignore-errors to be used by linkfix 2015-06-25 21:30:35 -04:00
Mikhail Korobov
2e55e65edc Merge pull request #1320 from barraponto/patch-2 
Fix SelectJmes documentation
 2015-06-25 23:20:46 +05:00
Capi Etheriel
4cea1c1231 Fix SelectJmes documentation 2015-06-25 15:11:56 -03:00
Yaroslav Halchenko
49fe915798 BF: fail if docs failed to build 2015-06-25 10:12:56 -04:00
Pablo Hoffman
8a140b6ba1 Merge pull request #1315 from scrapy/downloader-slots-cleanup 
Small downloader slots cleanup
 2015-06-24 16:25:13 -03:00
Mikhail Korobov
ea4b175c2d Merge pull request #1254 from scrapy/bugfix-1232 
[MRG +1] Unquote request path before passing to FTPClient, it already escape paths
 2015-06-24 18:04:45 +05:00