Andrey Rakhmatullin
ba5df629a2
Refactor downloader tests ( #6647 )
...
* Make download handler test base classes abstract.
* Small cleanup.
* Don't run the full test suite for special HTTP cases.
* Don't run tests in imported base classes.
* Remove an obsolete service_identity check.
* Move FTP imports back to the top level.
* Simplify the H2DownloadHandler import.
* Forbig pytest 8.2.x.
* Revert "Simplify the H2DownloadHandler import."
This reverts commit ed187046ac53c395c7423c0f5e6fb2bc7c27838f.
2025-02-03 20:11:47 +05:00
Andrey Rakhmatullin
d4b152bbf6
Drop PyPy 3.9, add a pypy3-extra-deps CI job. ( #6613 )
2025-01-23 09:22:18 +01:00
Andrey Rakhmatullin
3154b08e90
Improve coverage speed on Python 3.12+.
2025-01-07 20:42:03 +05:00
Andrey Rakhmatullin
7dfbecd392
Fix tracking of coverage in subprocesses.
2025-01-07 20:41:48 +05:00
Andrey Rakhmatullin
f7af7b282d
Bump mypy and stubs.
2024-12-29 16:45:26 +05:00
Andrey Rakhmatullin
4a0c05749c
Bump tool versions.
2024-12-29 14:29:27 +05:00
Swayam Gupta
8c23da943c
Integrating configs into pyproject.toml ( #6547 )
2024-11-19 19:21:15 +05:00
Andrey Rakhmatullin
d85c39f5bc
Deprecation removals. ( #6500 )
...
* Deprecation removals.
* Clean up the default pytest filterwarnings.
* Remove test_get_images_old().
* Redo boto-requiring test filtering.
* Remove an unused function.
* Improve the Crawler.crawl() error message.
* Fix the test.
2024-10-31 18:06:22 +05:00
Andrey Rakhmatullin
d10c58ff38
Bump pyftpdlib to the version supporting Python 3.13 on Windows.
2024-10-22 19:07:21 +05:00
Andrey Rakhmatullin
7e07d48cc5
Small 3.7 and 3.8 cleanup.
2024-10-17 23:22:37 +05:00
Andrey Rakhmatullin
f65e64a724
Misc typing improvements. ( #6494 )
2024-10-16 18:38:43 +02:00
Vsevolod Breus
5391663072
Drop Python 3.8 Support ( #6472 )
2024-10-16 10:03:16 +02:00
Andrey Rakhmatullin
87651fdf47
Don't use types-setuptools.
2024-10-08 16:04:26 +05:00
Andrey Rakhmatullin
5794071f96
Typing fixes and updates. ( #6460 )
2024-08-23 12:48:01 +02:00
Andrey Rakhmatullin
3c9c1a31bc
Bump pylint.
2024-07-11 12:30:12 +05:00
Andrey Rakhmatullin
129dbfa0bf
Bump tool versions.
2024-07-11 12:23:43 +05:00
Andrey Rakhmatullin
96d6519b25
Bump twine in twinecheck. ( #6416 )
2024-06-26 14:43:59 +02:00
Andrey Rakhmatullin
a364560fad
Unpin markupsafe in extra-deps. ( #6403 )
2024-06-17 11:38:10 +02:00
Andrey Rakhmatullin
de146ad7ce
Bump typing deps.
2024-06-05 22:09:19 +05:00
Andrey Rakhmatullin
9ba4dd311d
Install typing stubs for boto3 and botocore. ( #6370 )
2024-05-28 10:27:49 +02:00
Adrián Chaves
d2f1e00a6a
Merge 2.11.2 changes ( #6363 )
2024-05-14 18:54:11 +02:00
Andrey Rakhmatullin
93f0628530
Improve typing for Spider.parse(). ( #6274 )
2024-05-13 11:55:45 +02:00
Andrey Rakhmatullin
57acad3c38
Full typing for scrapy/extensions, part 3. ( #6325 )
2024-04-29 09:43:45 +02:00
Lucas Belo
4460d3ed96
Remove tests/requirements.txt and refactor extra deps ( #6272 )
...
Co-authored-by: lucasbelo777 <lucas.belo@cialdnb.com>
2024-03-13 07:22:48 +01:00
Yuri H. Galvao
4cd94aa668
Restore brotlipy support ( #6261 )
2024-03-01 11:07:38 +01:00
Andrey Rakhmatullin
4f9dd998dc
Bump pylint, cleanup the ignored tags.
2024-02-28 14:31:21 +05:00
Andrey Rakhmatullin
d2c05d9d96
Bump mypy and type stubs.
2024-02-28 14:31:21 +05:00
Adrián Chaves
6bd45bb6d9
Merge remote-tracking branch 'scrapy/2.11' into 2.11-port
2024-02-15 06:39:50 +01:00
Andrey Rakhmatullin
68fccb1d58
Fix and re-enable newer mitmproxy usage in tests.
2024-01-06 01:35:56 +04:00
Andrey Rakhmatullin
5e4fb0bc5f
Re-enable uvloop tests on 3.12 ( #6098 )
2023-11-16 19:16:31 +04:00
Andrey Rakhmatullin
4cb2fc2c3b
Update typing package versions.
2023-10-31 22:55:39 +04:00
Andrey Rakhmatullin
991121fa91
Re-enable uvloop tests on 3.12 ( #6098 )
2023-10-17 19:24:44 +02:00
Andrey Rakhmatullin
da39fbd270
Update tool versions ( #6046 )
2023-09-12 20:07:10 +02:00
Andrey Rakhmatullin
2c7484d433
Merge remote-tracking branch 'origin/master' into typing-utils-2
2023-08-07 14:55:38 +04:00
Andrey Rakhmatullin
110d5fffb4
Update tool versions. ( #6002 )
2023-08-07 10:57:48 +02:00
Andrey Rakhmatullin
f5f593e5f5
Remove a workaround for a w3lib typing bug.
2023-08-06 17:46:28 +04:00
Andrey Rakhmatullin
5e1582491b
mypy --show-error-codes is the default now.
2023-07-22 23:19:25 +04:00
Andrey Rakhmatullin
187e8f9a2d
Typing for scrapy/settings/__init__.py.
2023-07-17 00:01:36 +04:00
Andrey Rakhmatullin
93962ebefc
Bump typing package versions.
2023-07-14 23:20:35 +04:00
Andrey Rakhmatullin
712ee98848
Merge branch 'master' into typing-utils
2023-06-24 18:31:56 +04:00
Andrey Rakhmatullin
075b89eab5
Bump lxml and cryptography to versions with 3.8 wheels available.
2023-06-18 19:08:41 +04:00
Andrey Rakhmatullin
2122278d4b
Drop Python 3.7 support.
2023-06-18 18:37:50 +04:00
Andrey Rakhmatullin
0adbd210ac
Fix extra-deps-pinned tests.
2023-06-13 19:34:26 +04:00
Andrey Rakhmatullin
85fe88f80f
Merge pull request #5833 from GodelTech/issue_960_s3_feed_export
...
Fix #960 : S3 Feed Export throws boto error
2023-06-13 18:44:06 +04:00
Andrey Rakhmatullin
048812ba35
Bump types-* versions.
2023-05-07 22:40:29 +04:00
Andrey Rakhmatullin
8c8fb67057
Update tool versions ( #5908 )
2023-04-24 09:34:34 +02:00
Jalil SA
5a37af146f
Update documentation expectations for Parsel 1.8.0 ( #5902 )
2023-04-21 09:29:57 +02:00
Andrey Rakhmatullin
d911837389
Merge pull request #5881 from sbartlett97/LinkExtractor-Patch
...
Patched LxmlParserLinkExtractor
2023-04-12 12:28:21 +04:00
Adrián Chaves
3f0c2fae5e
Skip test_skip_bad_links based on the w3lib version
2023-04-12 09:28:28 +02:00
Andrey Rakhmatullin
c7730627a0
Typing improvements for some core components ( #5889 )
2023-04-11 13:47:41 +02:00
