scrapy

CrawlerProcess

Merge pull request #6112 from wRAR/test-shutdown-forced

2023-11-16 19:16:52 +04:00

CrawlerRunner

Replace urlparse with urlparse_cached where possible (#6229 )

2024-02-20 12:47:29 +01:00

keys

Remove datetime.utcnow() usage (#6014 )

2023-08-21 15:51:49 +02:00

mocks

Fix and remove most of the entries from the mypy ignore list (#6137 )

2023-11-07 09:34:35 +01:00

sample_data

Add support for multiple-compressed responses (#6063 )

2024-02-22 12:16:24 +01:00

test_cmdline

Improve finding tests.test_cmdline.settings.

2023-06-12 21:50:29 +04:00

test_cmdline_crawl_with_pipeline

sort imports with isort

2023-01-25 14:25:15 -06:00

test_settings

create_instance → build_from_crawler, build_from_settings (#6169 )

2023-12-18 11:51:02 +01:00

test_spiderloader

Remove usage of deprecated mktemp (#5285 )

2024-02-26 19:53:06 +01:00

test_utils_misc

create_instance → build_from_crawler, build_from_settings (#6169 )

2023-12-18 11:51:02 +01:00

__init__.py

adding black formatter to all the code

2022-11-29 11:30:46 -03:00

ftpserver.py

adding black formatter to all the code

2022-11-29 11:30:46 -03:00

ignores.txt

Remove deprecated classes BaseSgmlLinkExtractor, RegexLinkExtractor and SgmlLinkExtractor (#4356 )

2020-07-17 12:40:04 +02:00

mockserver.py

Don't rely on get_testenv() for running mockserver.

2023-06-04 19:59:58 +04:00

pipelines.py

reaplying black, fixing conflicts and ignoring bandit checks on test directory

2023-01-20 10:55:46 -03:00

requirements.txt

Re-enable uvloop tests on 3.12 (#6098 )

2023-11-16 19:16:31 +04:00

spiders.py

refactor(yield): use yield from syntax

2024-01-05 12:30:10 +01:00

test_addons.py

create_instance → build_from_crawler, build_from_settings (#6169 )

2023-12-18 11:51:02 +01:00

test_closespider.py

improve tests by having SlowSpider

2023-07-18 22:29:15 +08:00

test_command_check.py

scrapy parse: fix the signature of callbacks from the CLI (#6182 )

2024-01-15 13:37:03 +01:00

test_command_fetch.py

Upgrade CI tools

2023-02-02 06:37:40 +01:00

test_command_parse.py

scrapy parse: fix the signature of callbacks from the CLI (#6182 )

2024-01-15 13:37:03 +01:00

test_command_shell.py

Merge pull request #6112 from wRAR/test-shutdown-forced

2023-11-16 19:16:52 +04:00

test_command_version.py

Upgrade CI tools

2023-02-02 06:37:40 +01:00

test_commands.py

Remove usage of deprecated mktemp (#5285 )

2024-02-26 19:53:06 +01:00

test_contracts.py

Check for async callbacks in contracts.

2023-08-06 17:28:34 +04:00

test_core_downloader.py

adding black formatter to all the code

2022-11-29 11:30:46 -03:00

test_crawl.py

Improve and simplify tests.

2023-09-13 14:17:41 +04:00

test_crawler.py

Add component getters to Crawler (#6181 )

2024-01-15 13:14:02 +01:00

test_dependencies.py

Remove obsolete top-level run code in tests.

2023-01-25 22:14:24 +04:00

test_downloader_handlers_http2.py

create_instance → build_from_crawler, build_from_settings (#6169 )

2023-12-18 11:51:02 +01:00

test_downloader_handlers.py

Remove usage of deprecated mktemp (#5285 )

2024-02-26 19:53:06 +01:00

test_downloadermiddleware_ajaxcrawlable.py

sort imports with isort

2023-01-25 14:25:15 -06:00

test_downloadermiddleware_cookies.py

sort imports with isort

2023-01-25 14:25:15 -06:00

test_downloadermiddleware_defaultheaders.py

sort imports with isort

2023-01-25 14:25:15 -06:00

test_downloadermiddleware_downloadtimeout.py

sort imports with isort

2023-01-25 14:25:15 -06:00

test_downloadermiddleware_httpauth.py

Remove support for using HttpAuthMiddleware without http_auth_domain

2023-10-17 20:20:38 -03:00

test_downloadermiddleware_httpcache.py

Add Crawler._load_settings().

2023-09-12 14:44:16 +04:00

test_downloadermiddleware_httpcompression.py

Add support for multiple-compressed responses (#6063 )

2024-02-22 12:16:24 +01:00

test_downloadermiddleware_httpproxy.py

Merge remote-tracking branch 'origin/master' into mypy-imports

2023-02-11 22:02:19 +04:00

test_downloadermiddleware_redirect.py

Drop the Authorization header on cross-domain redirect

2023-11-15 15:39:30 +01:00

test_downloadermiddleware_retry.py

Improve the backwards compatibility for RetryMiddleware.EXCEPTIONS_TO_RETRY.

2023-09-14 15:51:00 +04:00

test_downloadermiddleware_robotstxt.py

Merge branch 'master' into no-callback

2023-01-30 15:43:05 +05:00

test_downloadermiddleware_stats.py

Removed some deprecated functions and functionalities (#6116 )

2023-10-30 09:59:11 +01:00

test_downloadermiddleware_useragent.py

sort imports with isort

2023-01-25 14:25:15 -06:00

test_downloadermiddleware.py

Add Crawler._load_settings().

2023-09-12 14:44:16 +04:00

test_downloaderslotssettings.py

per_slot_settings(docs): code style fix 3 (from previous pre-commit check)

2023-02-16 18:19:36 +02:00

test_dupefilters.py

Add Crawler._load_settings().

2023-09-12 14:44:16 +04:00

test_engine_stop_download_bytes.py

sort imports with isort

2023-01-25 14:25:15 -06:00

test_engine_stop_download_headers.py

sort imports with isort

2023-01-25 14:25:15 -06:00

test_engine.py

Add Crawler._load_settings().

2023-09-12 14:44:16 +04:00

test_exporters.py

Fix and remove most of the entries from the mypy ignore list (#6137 )

2023-11-07 09:34:35 +01:00

test_extension_periodic_log.py

fix(typo): correct successfully

2024-01-05 10:50:45 +01:00

test_extension_telnet.py

Add Crawler._load_settings().

2023-09-12 14:44:16 +04:00

test_feedexport.py

Do not close the underlying file from compression plugins (#6239 )

2024-02-21 14:27:42 +01:00

test_http2_client_protocol.py

Remove usage of deprecated mktemp (#5285 )

2024-02-26 19:53:06 +01:00

test_http_cookies.py

Replace urlparse with urlparse_cached where possible (#6229 )

2024-02-20 12:47:29 +01:00

test_http_headers.py

sort imports with isort

2023-01-25 14:25:15 -06:00

test_http_request.py

Merge pull request #6235 from elramen/http_request_tests

2024-02-22 12:17:11 +05:00

test_http_response.py

fix: test_cache_json_response

2023-08-17 10:24:34 -06:00

test_item.py

adding black formatter to all the code

2022-11-29 11:30:46 -03:00

test_link.py

adding black formatter to all the code

2022-11-29 11:30:46 -03:00

test_linkextractors.py

test #8 made tests cleaner

2024-02-21 16:03:51 +01:00

test_loader_deprecated.py

Remove deprecated code moved to itemloaders

2023-10-17 18:20:12 -03:00

test_loader.py

Fix and remove most of the entries from the mypy ignore list (#6137 )

2023-11-07 09:34:35 +01:00

test_logformatter.py

Upgrade CI tools

2023-02-02 06:37:40 +01:00

test_logstats.py

Refactor LogStats extension to log IPM and RPM to stats on spider_close (#4111 )

2024-02-16 12:25:38 +01:00

test_mail.py

Fix charset handling in MailSender #5096 (#5118 )

2023-09-07 07:47:42 +02:00

test_middleware.py

Improve NotConfigured handling when clspath is a class.

2023-08-01 20:20:15 +04:00

test_pipeline_crawl.py

Remove usage of deprecated mktemp (#5285 )

2024-02-26 19:53:06 +01:00

test_pipeline_files.py

Merge pull request #6083 from wRAR/py3.12-release

2023-11-16 19:14:47 +04:00

test_pipeline_images.py

Fix and remove most of the entries from the mypy ignore list (#6137 )

2023-11-07 09:34:35 +01:00

test_pipeline_media.py

Remove leftover from _make_compatible removal

2023-10-17 19:44:12 -03:00

test_pipelines.py

sort imports with isort

2023-01-25 14:25:15 -06:00

test_pqueues.py

sort imports with isort

2023-01-25 14:25:15 -06:00

test_proxy_connect.py

Fix and re-enable newer mitmproxy usage in tests.

2024-01-06 01:35:56 +04:00

test_request_attribute_binding.py

sort imports with isort

2023-01-25 14:25:15 -06:00

test_request_cb_kwargs.py

Fix and remove most of the entries from the mypy ignore list (#6137 )

2023-11-07 09:34:35 +01:00

test_request_dict.py

Remove functions deprecated in 2.6.0 (#5996 )

2023-08-03 17:06:55 +02:00

test_request_left.py

sort imports with isort

2023-01-25 14:25:15 -06:00

test_responsetypes.py

Add JsonResponse (#6174 )

2023-12-21 10:36:21 +01:00

test_robotstxt_interface.py

IOError and other cleanup (#4716 )

2023-06-21 20:08:53 +02:00

test_scheduler_base.py

Replace urlparse with urlparse_cached where possible (#6229 )

2024-02-20 12:47:29 +01:00

test_scheduler.py

Fix and remove most of the entries from the mypy ignore list (#6137 )

2023-11-07 09:34:35 +01:00

test_selector.py

fix: tests/tes_selector.py

2023-05-02 19:40:04 -06:00

test_signals.py

sort imports with isort

2023-01-25 14:25:15 -06:00

test_spider.py

Merge remote-tracking branch 'scrapy/2.11' into 2.11-port

2024-02-15 06:39:50 +01:00

test_spidermiddleware_depth.py

sort imports with isort

2023-01-25 14:25:15 -06:00

test_spidermiddleware_httperror.py

Fix and remove most of the entries from the mypy ignore list (#6137 )

2023-11-07 09:34:35 +01:00

test_spidermiddleware_offsite.py

Add Crawler._load_settings().

2023-09-12 14:44:16 +04:00

test_spidermiddleware_output_chain.py

adding black formatter to all the code

2022-11-29 11:30:46 -03:00

test_spidermiddleware_referer.py

Fix and remove most of the entries from the mypy ignore list (#6137 )

2023-11-07 09:34:35 +01:00

test_spidermiddleware_urllength.py

Add Crawler._load_settings().

2023-09-12 14:44:16 +04:00

test_spidermiddleware.py

refactor(yield): use yield from syntax

2024-01-05 12:30:10 +01:00

test_spiderstate.py

Remove usage of deprecated mktemp (#5285 )

2024-02-26 19:53:06 +01:00

test_squeues_request.py

Remove usage of deprecated mktemp (#5285 )

2024-02-26 19:53:06 +01:00

test_squeues.py

Upgrade CI tools

2023-02-02 06:37:40 +01:00

test_stats.py

Remove datetime.utcnow() usage (#6014 )

2023-08-21 15:51:49 +02:00

test_toplevel.py

sort imports with isort

2023-01-25 14:25:15 -06:00

test_urlparse_monkeypatches.py

sort imports with isort

2023-01-25 14:25:15 -06:00

test_utils_asyncgen.py

Implement spider middleware iterable upgrade/downgrade.

2022-01-11 18:28:32 +05:00

test_utils_asyncio.py

Actually run test_set_asyncio_event_loop().

2023-06-14 18:23:29 +04:00

test_utils_conf.py

Deprecate the custom attribute of build_component_list(). (#5993 )

2023-08-02 14:21:06 +02:00

test_utils_console.py

Upgrade CI tools

2023-02-02 06:37:40 +01:00

test_utils_curl.py

feat: added test_post_data_raw_with_string_prefix

2023-04-18 22:28:16 -05:00

test_utils_datatypes.py

Merge branch 'master' into case-insensitive-dict

2023-06-21 22:12:44 +04:00

test_utils_defer.py

refactor(yield): use yield from syntax

2024-01-05 12:30:10 +01:00

test_utils_deprecate.py

Merge branch 'master' into addons

2023-06-14 15:37:08 +04:00

test_utils_display.py

sort imports with isort

2023-01-25 14:25:15 -06:00

test_utils_gz.py

IOError and other cleanup (#4716 )

2023-06-21 20:08:53 +02:00

test_utils_httpobj.py

adding black formatter to all the code

2022-11-29 11:30:46 -03:00

test_utils_iterators.py

Merge remote-tracking branch 'scrapy/2.11' into 2.11-port

2024-02-15 06:39:50 +01:00

test_utils_log.py

Add Crawler._load_settings().

2023-09-12 14:44:16 +04:00

test_utils_project.py

sort imports with isort

2023-01-25 14:25:15 -06:00

test_utils_python.py

Improve get_func_args (#5885 )

2023-04-13 11:44:20 +02:00

test_utils_request.py

Simplify the logic

2024-01-31 12:53:08 -03:00

test_utils_response.py

Merge remote-tracking branch 'scrapy/2.11' into 2.11-port

2024-02-15 06:39:50 +01:00

test_utils_serialize.py

Fix and remove most of the entries from the mypy ignore list (#6137 )

2023-11-07 09:34:35 +01:00

test_utils_signal.py

adding black formatter to all the code

2022-11-29 11:30:46 -03:00

test_utils_sitemap.py

adding black formatter to all the code

2022-11-29 11:30:46 -03:00

test_utils_spider.py

sort imports with isort

2023-01-25 14:25:15 -06:00

test_utils_template.py

Upgrade CI tools

2023-02-02 06:37:40 +01:00

test_utils_trackref.py

adding black formatter to all the code

2022-11-29 11:30:46 -03:00

test_utils_url.py

Fix and remove most of the entries from the mypy ignore list (#6137 )

2023-11-07 09:34:35 +01:00

test_webclient.py

Remove usage of deprecated mktemp (#5285 )

2024-02-26 19:53:06 +01:00

upper-constraints.txt

upper-constraints.txt: restrict botocore further

2021-03-18 23:42:29 +01:00