1
0
mirror of https://github.com/scrapy/scrapy.git synced 2025-02-06 10:24:24 +00:00

10711 Commits

Author SHA1 Message Date
Andrey Rakhmatullin
29bb869284 Remove the beta block. 2024-10-08 15:43:17 +05:00
Andrey Rakhmatullin
df6c51af0f Use the 3.13 release. 2024-10-08 15:37:49 +05:00
Andrey Rakhmatullin
8c133fcf7e Remove the installation dependency on setuptools. 2024-10-07 23:04:48 +05:00
mmoriniere
46cddc6ecf
Ignore SyntaxError as well when SPIDER_LOADER_WARN_ONLY is set to True (#6484) 2024-10-02 10:04:03 +02:00
Andrey Rakhmatullin
e139d22db9 Fix expectations for get_func_args() on 3.13. 2024-09-20 19:28:28 +05:00
Andrey Rakhmatullin
ee9ee2d12d Revert bpython restrictions. 2024-09-12 14:32:32 +05:00
Andrey Rakhmatullin
b3f562d6a5 Revert "Revert uvloop restrictions."
This reverts commit c21c4a18509ec9657bfe6e6f99bd913bba7ea41d.
2024-09-12 14:31:50 +05:00
Andrey Rakhmatullin
ae967d1c06
Merge pull request #6475 from LucasSD/remove-debug-log-message
Remove log pollution from core.engine signal handler (#6433)
2024-09-10 12:01:37 +05:00
LucasSD
f260f819e0 Remove debug log message from _schedule_request method 2024-09-09 20:26:02 +01:00
Daniel O'Connor
67ab8d4650
Refactor genspider slightly so template variables can be overridden (#6470) 2024-08-28 21:07:49 +02:00
Andrey Rakhmatullin
c9d85faaf2
Merge pull request #6469 from Laerte/master
Add support for meta in Spider Contracts
2024-08-28 14:53:39 +05:00
Laerte Pereira
ddbdfeb699
Update scrapy/contracts/default.py 2024-08-27 07:24:57 -03:00
Laerte Pereira
4f9b2343c0 Merge branch 'master' of github.com:Laerte/scrapy 2024-08-27 07:16:10 -03:00
Laerte Pereira
3c2a9fa262 update docs 2024-08-27 07:16:01 -03:00
Laerte Pereira
f68f29dd13
Update docs/topics/contracts.rst 2024-08-26 23:37:57 -03:00
Laerte Pereira
b85e5a66ed Add support for meta in Spider Contracts 2024-08-26 23:21:09 -03:00
Georgiy Zatserklianyi
6ce0342beb
Allow yielding items from start_requests (#6417)
Co-authored-by: Georgiy Zatserklianyi <george.zatseklyany@gmail.com>
Co-authored-by: Adrián Chaves <adrian@chaves.io>
Co-authored-by: Andrey Rakhmatullin <wrar@wrar.name>
2024-08-26 20:53:06 +02:00
Andrey Rakhmatullin
5794071f96
Typing fixes and updates. (#6460) 2024-08-23 12:48:01 +02:00
Andrey Rakhmatullin
c21c4a1850 Revert uvloop restrictions. 2024-08-21 01:06:05 +05:00
mlmsmith
af15bd1dad
minor changes to items section of docs (#6462) 2024-08-19 13:55:09 +02:00
Andrey Rakhmatullin
70756fd57c Revert cffi and Pillow restrictions. 2024-08-11 13:57:13 +05:00
Andrey Rakhmatullin
1e68d3c0bf Merge branch 'master' into py313 2024-08-11 13:46:51 +05:00
mlmsmith
b9ef1326a5
Proofread the commands documentation (#6449) 2024-08-01 09:29:11 +02:00
Adrián Chaves
03a15ced4f
Do not suggest logging dropped items twice (#6448)
Co-authored-by: Kevin Lloyd Bernal <kevinoxy@gmail.com>
2024-07-31 11:37:19 +02:00
mlmsmith
e376c0b31a
Tutorial edits (#6440) 2024-07-24 06:40:01 +02:00
Andrey Rakhmatullin
06f9c289d1
Merge pull request #6434 from guillermo-bondonno/feature/closespider_pagecount_no_item
Feature/closespider pagecount no item
2024-07-12 16:31:05 +05:00
guillermo-bondonno
026d606528
clean closespider_pagecount_no_item docs section
Co-authored-by: Andrey Rakhmatullin <wrar@wrar.name>
2024-07-12 08:09:03 -03:00
guillermo-bondonno
9cdbcb4f63 add test_closespider_pagecount_no_item_with_pagecount 2024-07-11 14:02:24 -03:00
guillermo-bondonno
5f0fad16f5 improve test_closespider_pagecount_no_item and corresponding test spider 2024-07-11 13:26:22 -03:00
guillermo-bondonno
a40d5281cf improve test_closespider_pagecount_no_item and MaxItemsSpider 2024-07-11 11:14:30 -03:00
Adrián Chaves
7a0a34b136
Merge pull request #6435 from wRAR/update-tools
Update tool versions
2024-07-11 10:26:04 +02:00
Andrey Rakhmatullin
3c9c1a31bc Bump pylint. 2024-07-11 12:30:12 +05:00
Andrey Rakhmatullin
435686830c Bump the Python version for RTD. 2024-07-11 12:25:13 +05:00
Andrey Rakhmatullin
129dbfa0bf Bump tool versions. 2024-07-11 12:23:43 +05:00
guillermo-bondonno
8646d2ec7b fix docs detail 2024-07-10 11:44:44 -03:00
guillermo-bondonno
59782d7308 update docs 2024-07-10 11:08:22 -03:00
guillermo-bondonno
d6352f9f66 refactor changes on closespider.py and improve test 2024-07-10 11:03:01 -03:00
guillermo-bondonno
a44818afea restore mitmproxy-dhparam 2024-07-09 16:07:55 -03:00
guillermo-bondonno
0b8604bb5d add CLOSESPIDER_PAGECOUNT_NO_ITEM to CloseSpider extension 2024-07-09 15:52:49 -03:00
Andrey Rakhmatullin
ceedb026f8
Remove top-level imports that install the reactor from scrapy.extensions.telnet. (#6432) 2024-07-09 08:34:58 +02:00
mlmsmith
d8ecd28c55
Documentation improvements (#6429) 2024-07-04 12:16:26 +02:00
Andrey Rakhmatullin
558b1d11d2
Use CallbackT for Request.callback. (#6422) 2024-07-01 09:30:49 +02:00
Andrey Rakhmatullin
41e15e93e7
Remove an obsolete import. (#6415) 2024-06-26 14:44:12 +02:00
Andrey Rakhmatullin
96d6519b25
Bump twine in twinecheck. (#6416) 2024-06-26 14:43:59 +02:00
Andrey Rakhmatullin
e47110f9a5
Add parameteres to most Deferred instances. (#6414) 2024-06-26 10:01:43 +02:00
Andrey Rakhmatullin
d08f559600
Add flake8-type-checking. (#6413) 2024-06-25 10:20:59 +02:00
mlmsmith
326e323e11
Apply grammar fixes (#6411) 2024-06-21 12:24:10 +02:00
Andrey Rakhmatullin
0e78ac609d
Merge pull request #6406 from wRAR/more-flake8
Add some flake8 plugins
2024-06-20 14:34:25 +05:00
Andrey Rakhmatullin
13d3b1af47 Split ignores into blocks. 2024-06-20 00:42:43 +05:00
Andrey Rakhmatullin
3d8dbd5648 flake8-bugbear 2024-06-20 00:27:38 +05:00