1
0
mirror of https://github.com/scrapy/scrapy.git synced 2025-03-14 03:19:15 +00:00

48 Commits

Author SHA1 Message Date
Eugenio Lacuesta
94d7ad76cb
Fix pycodestyle E2XX (whitespace) (#4468) 2020-04-15 14:11:37 +02:00
Eugenio Lacuesta
e2d5d357a7
Fix pycodestyle E502 2020-04-01 14:24:30 -03:00
Marc Hernandez Cabot
6e8e117aee fix flake E211 2020-02-22 12:32:38 +01:00
Marc Hernandez Cabot
69a8648bef fix E251 2020-02-22 12:32:38 +01:00
Marc Hernandez Cabot
9ad10bb6f7 fix E131 2020-02-22 12:32:38 +01:00
Marc Hernandez Cabot
b49ece0b87 fix E701 and E271 flake8 2020-02-22 12:32:38 +01:00
Marc Hernandez Cabot
6fb85951ce fix E22X flake8 2020-02-21 08:39:14 +01:00
Marc Hernández
91bbc70bc1
fix E30X flake8 (#4355) 2020-02-21 06:05:31 +01:00
elacuesta
35dafef7f1
Specify Twisted reactor (TWISTED_REACTOR setting) (#4294)
* Add the ability to install a specific reactor

* Add docs for the TWISTED_REACTOR setting

* Add tests for the TWISTED_REACTOR setting

* Update asyncio reactor test

* Ignore W503 globally

W503 is not PEP8-compliant:
c59c4376ad

* Line length adjustment

* Adjust asyncio reactor tests

* Merge ASYNCIO_ENABLED and TWISTED_REACTOR settings

* More docs about TWISTED_REACTOR

* Fix asyncio reactor test

* Docs: fix title

* Reword docs

* Check the TWISTED_REACTOR setting outside of the installing function

* Remove unrelated change

* Update scrapy/utils/log.py

Co-Authored-By: Adrián Chaves <adrian@chaves.io>

* Update docs/topics/settings.rst

Co-Authored-By: Adrián Chaves <adrian@chaves.io>

* Update docs/topics/settings.rst

Co-Authored-By: Adrián Chaves <adrian@chaves.io>

Co-authored-by: Adrián Chaves <adrian@chaves.io>
2020-02-06 22:42:34 +05:00
Mikhail Korobov
8b8df31961
Merge pull request #4227 from elacuesta/name-resolver
Name resolver with IPv6 support
2020-01-25 05:03:13 +05:00
Eugenio Lacuesta
735c0ceb78
Custom name resolver implementing twisted.internet.interfaces.IHostnameResolver 2020-01-15 12:38:08 -03:00
Andrey Rakhmatullin
9d8c54c0f2 Fix/ignore flake8 problems. 2020-01-09 14:49:02 +05:00
Andrey Rakhmatullin
20289be810 Merge remote-tracking branch 'origin/master' into asyncio-base 2019-12-20 19:31:20 +05:00
Mikhail Korobov
fb3fb17c28
Merge pull request #4045 from Gallaecio/documentation-coverage
Deprecate FilteringLinkExtractor direct usage; add API docs for scrapy.linkextractors
2019-12-20 02:01:45 +05:00
Mikhail Korobov
8f7faaa63d
Merge pull request #4190 from Gallaecio/doctest
Make developer-tools doctests pass
2019-12-18 23:40:21 +05:00
Marc Hernandez Cabot
a5de2c64e6 fix W291, W292, W293 (whitespaces) 2019-12-18 16:33:46 +01:00
Adrián Chaves
607815dfc2
Merge branch 'master' into documentation-coverage 2019-12-17 16:54:27 +01:00
Marc Hernández
63cf5c75c8 Fix E502: backslash is redundant between brackets (#4238) 2019-12-17 13:53:15 +01:00
Andrey Rakhmatullin
2db7d45378 Enable skipping tests based on --reactor. 2019-12-16 19:25:49 +05:00
Adrián Chaves
a4ef9750f9 Fix Flake8-reported issues 2019-12-13 14:32:06 +01:00
Adrián Chaves
b5c4c2cae8
Keep 2 spaces between code and inline comments (#4195) 2019-12-13 14:20:48 +01:00
Andrey Rakhmatullin
c079d5002b Run tests without asyncio support by default, add py35-asyncio and py38-asyncio envs. 2019-12-04 21:32:56 +05:00
Andrey Rakhmatullin
794cf71806 Fix or ignore flake8 problems. 2019-12-04 21:32:56 +05:00
Andrey Rakhmatullin
9777639533 Run tests using the asyncio reactor. 2019-12-04 21:32:56 +05:00
Adrián Chaves
54b056c4be Make developer-tools doctests pass 2019-11-25 12:32:35 +01:00
Mikhail Korobov
16e0636dcf
Merge pull request #4186 from Gallaecio/lgtm
Remove unused imports
2019-11-22 12:28:29 +05:00
Mikhail Korobov
82c01c261f
Merge pull request #4184 from Gallaecio/doctest
Make debug doctests pass
2019-11-21 20:53:56 +05:00
Mikhail Korobov
d2b73b8e21
Merge pull request #4114 from scrapy/remove-py2-tests
Remove py2 tests
2019-11-21 18:22:10 +05:00
Adrián Chaves
a2bf340bab Remove unused imports 2019-11-21 14:21:17 +01:00
Adrián Chaves
f251dda268 Make debug doctests pass 2019-11-21 11:59:10 +01:00
Mikhail Korobov
f1fd7ec318
Merge pull request #4171 from Gallaecio/doctest
Make command doctests pass
2019-11-20 19:47:22 +05:00
Andrey Rakhmatullin
922a66cf07 Fix or ignore flake8 problems. 2019-11-19 13:52:49 +05:00
Adrián Chaves
f261cf65e9 Add missing blank lines between functions and classes
Also fixed 2 unrelated Flake8 issues
2019-11-18 17:16:09 +01:00
Adrián Chaves
74589df02f Make command doctests pass 2019-11-18 14:51:44 +01:00
Marc Hernandez Cabot
0e252f5a13 fix E711 and E713 2019-11-15 19:12:43 +01:00
Mikhail Korobov
7b4637d083
Merge pull request #4146 from Gallaecio/doctest
Make tutorial doctests pass
2019-11-15 00:19:20 +05:00
Adrián Chaves
33ef24c757 Add missing whitespace after ‘,’, ‘;’ or ‘:’ 2019-11-13 10:52:05 +01:00
Adrián Chaves
79d2f99995 Make tutorial doctests pass 2019-11-12 08:08:50 +01:00
Adrián Chaves
1df5755699 Set the bases for testing code examples from the documentation 2019-11-08 16:00:10 +01:00
Marc Hernández
c377c14e32 Fix W391 Blank line at end of file (#4137) 2019-11-07 17:47:35 +01:00
Marc Hernández
e8b1e46e85 Add pytest-flake8 (#3945) 2019-11-07 14:05:01 +01:00
Julia Medina
a47859540a Don't collect tests by their class name 2015-05-04 18:10:04 -03:00
Julia Medina
c2d716807a Use LogCapture in testfixtures package for tests
This allows to remove `get_testlog` helper, `flushLoggedErrors` from
twisted.trial.unittest.TestCase and Twisted log observers created for
each test on conftest.py.
2015-04-22 17:24:40 -03:00
Daniel Graña
70ee66ba0c Collect the list of packages not working on python3 2014-07-31 14:06:34 -03:00
Daniel Graña
eb1cf303d3 use pytest.ini to enable twisted plugin 2014-07-30 19:45:08 -03:00
Mikhail Korobov
c3426e952b TST fix tests that became broken after adding top-level imports and switching to py.test.
py.test replaces AssertionError exception with its own subclass in an import hook.
For some reason when top-level shortcuts were added "except AssertionError" in
contracts.__init__ meant "except py.test AssertionError" while scrapy.exceptions.ContractFail
was still a subclass of a builtin AssertionError, so Contracts reported errors
instead of failures and this made tests in test_contracts.py fail.

For now - just disable fancy py.test asserts.
2014-04-15 06:54:14 +06:00
Julia Medina
560a84657c Support doctest and __init__.py test discover in pytest 2014-04-04 21:43:12 -03:00
Julia Medina
20b4c8f3ea Trial functionality for running tests with pytest
* Change current dir to tmp dir on each test run
  * Log twisted with test.log
2014-04-04 21:42:00 -03:00