1
0
mirror of https://github.com/scrapy/scrapy.git synced 2025-02-23 12:23:47 +00:00

6779 Commits

Author SHA1 Message Date
Mikhail Korobov
25ac4691b4 require parsel 1.5+ 2018-09-12 17:57:27 +05:00
Daniel Graña
7223978594
Merge pull request #3381 from StasDeep/fix/issue-3380
[MRG+1] Use dont_filter=True for contracts requests
2018-09-06 11:41:02 -03:00
Daniel Graña
2aae514f99
Merge branch 'master' into fix/issue-3380 2018-09-05 12:25:07 -03:00
Daniel Graña
5176765589
Merge pull request #3377 from StasDeep/feature/issue-3364
Add handling of errors in contract methods
2018-09-05 12:24:50 -03:00
Daniel Graña
d7b98a3714
Merge branch 'master' into feature/issue-3364 2018-09-05 11:26:59 -03:00
Daniel Graña
ae8a0dc77c
Merge pull request #3383 from StasDeep/feature/issue-3382
[MRG+1] Add ability to use FormRequest in contracts
2018-09-05 11:21:26 -03:00
Daniel Graña
4da0b59cd7
Merge pull request #3393 from whalebot-helmsman/singal-request-added-to-downloader-slot
[MRG+1] New signal for reqeuests reached downloader
2018-09-05 11:17:13 -03:00
Stas Glubokiy
8dbbbd1395 Use request_cls attribute in contract definition 2018-09-03 20:07:37 +03:00
Vostretsov Nikita
c02cfa574c remove comma 2018-08-29 11:21:55 +00:00
Daniel Graña
0007cd032d
Merge pull request #3405 from stav/offsite-pep8
[MRG+1] PEP8 ofsite middleware
2018-08-28 14:51:39 -03:00
Steven Almeroth
6e9fa3a41f PEP8 ofsite middleware 2018-08-24 15:18:16 -04:00
Mikhail Korobov
e45ef7dcd9
Merge pull request #3400 from testingcan/docs-developer-tools
[MRG+1] Added general guide for developer tools

Fixes #3373 and #3372.
2018-08-23 19:44:14 +05:00
Raphael Wuillemier
79de3d569a Removed obsolete firebug-images 2018-08-23 16:19:13 +02:00
testingcan
e98e7f8506
Added missing curly brace 2018-08-23 14:50:49 +02:00
Raphael Wuillemier
4d3aaabbca Updated code, added code snippets and improved readability 2018-08-23 12:40:31 +02:00
testingcan
3a71e7dbce
Increased length of "=" 2018-08-22 16:57:51 +02:00
Raphael Wuillemier
af555cab23 Added general guide for developer tools instead of Firefox and Firebug-sections 2018-08-22 14:15:53 +02:00
Stas Glubokiy
9ab85fe788 Merge branch 'master' of github.com:StasDeep/scrapy into feature/issue-3382 2018-08-19 17:21:28 +03:00
Stas Glubokiy
57824600a8 Use six.get_unbound_function in test_same_url 2018-08-19 16:56:41 +03:00
Stas Glubokiy
0467737cf0 Fix mockserver usage 2018-08-18 15:43:46 +03:00
Stas Glubokiy
1311f6b536 Merge branch 'master' of github.com:StasDeep/scrapy into fix/issue-3380 2018-08-18 15:42:10 +03:00
Stas Glubokiy
e2de0a7203 Use except Exception 2018-08-18 15:24:30 +03:00
Stas Glubokiy
11576f5c8f Merge branch 'master' of github.com:StasDeep/scrapy into feature/issue-3364 2018-08-18 15:24:07 +03:00
Vostretsov Nikita
561ad3b63c emit new signal 2018-08-17 14:40:24 +00:00
Vostretsov Nikita
afb1458bd3 tests for new signal 2018-08-17 14:39:54 +00:00
Vostretsov Nikita
597b8a97ad documentation for new signal 2018-08-17 14:39:42 +00:00
Vostretsov Nikita
d95762db7c new signal 2018-08-17 14:39:24 +00:00
Vostretsov Nikita
2b212d4266 ignore cache for pytests 2018-08-17 14:39:06 +00:00
Mikhail Korobov
c7654f7cb1
Merge pull request #3379 from StasDeep/fix/issue-3378
Use inspect.getmembers in tested_methods_from_spidercls
2018-08-17 19:25:41 +05:00
Stas Glubokiy
ddd69f4c10 Use MockServer in test_same_url 2018-08-15 20:39:43 +03:00
Stas Glubokiy
2cb4decb6a Move TestSameUrlSpider to test method 2018-08-15 20:36:10 +03:00
Stas Glubokiy
4de493efdd Add test_same_url 2018-08-15 20:24:00 +03:00
Mikhail Korobov
91f986ecf4
Merge pull request #3315 from scrapy/test-on-windows
Enable AppVeyor CI for running test suite on Windows env
2018-08-15 21:18:37 +05:00
Daniel Graña
38608bc249 Use ignore_errors option from rmtree 2018-08-15 11:59:09 -03:00
Daniel Graña
4eaf8690b1 Twisted's unittest.Testcase assertRaiess can't be used as context manager 2018-08-15 08:54:18 -03:00
Daniel Grana
a304d6b692 Workaround to pass tests/test_feedexporter.py under windows 2018-08-15 02:23:07 -07:00
Daniel Grana
e7fe243c3e Fix test_crawler under windows 2018-08-15 01:09:23 -07:00
Daniel Grana
96517cb7de Fix test_command_parse under windows 2018-08-15 01:08:40 -07:00
Daniel Graña
d93d960319 Fix test_utils_project under Windows 2018-08-15 01:53:20 -03:00
Jakob de Maeyer
cb28175750 Fix csviter tests by explicitly using newline only 2018-08-15 01:35:01 -03:00
Daniel Graña
ca53a8699a Fix presentation of template directory in startproject command 2018-08-15 01:35:01 -03:00
Daniel Graña
0e532e3dd8 Creating a connection to 0.0.0.0 fails on windows but not on linux nor mac 2018-08-15 01:35:01 -03:00
Daniel Graña
ed068e59b7 Cache pip cache and do not rebuild tags on appveyor and travis 2018-08-15 01:35:01 -03:00
Daniel Graña
a21abac743 fix ftp tests on windows 2018-08-15 01:35:01 -03:00
Daniel Graña
fb09148c91 Fix bad merge on ParseCommandTest 2018-08-15 01:35:01 -03:00
Jakob de Maeyer
22505a34a9 Fix cmdline profiling test on Windows by using proper path composing 2018-08-15 01:35:01 -03:00
Jakob de Maeyer
034152961d Fix Feedexport test in Windows by using proper file URI 2018-08-15 01:35:01 -03:00
Daniel Graña
ed8255bde0 Fix merge issues with stderr/out fixes for windows buffering 2018-08-15 01:33:38 -03:00
Jakob de Maeyer
57a1d66c61 Fix test issues caused by Windows pipe buffer filling up 2018-08-15 01:33:38 -03:00
Jakob de Maeyer
152fde70b1 Fix FTPTestCase by using Windows-friendly temporary file name 2018-08-15 01:33:38 -03:00