scrapy

keys

revert wrong changes

2018-03-13 13:05:37 +08:00

mocks

Switch from to ` where inline code formatting is desired

2019-03-01 16:56:58 +01:00

sample_data

Add file listing resource + redirecting resource to MockServer

2017-03-10 21:35:25 +01:00

test_cmdline

Fix cmdline profiling test on Windows by using proper path composing

2018-08-15 01:35:01 -03:00

test_settings

Remove deprecated CrawlerSettings class and Settings attributes

2018-07-09 17:16:31 +00:00

test_spiderloader

[Tests] Monkey patch unittest.TestCase to prevent DeprecationWarning(s)

2019-07-13 19:26:59 -03:00

test_utils_misc

Restore alphabetic order and two lines between import and code

2019-05-03 13:55:18 +02:00

__init__.py

Suggested changes

2019-07-15 12:37:09 -03:00

constraints.txt

Added constrain on lxml version based on Python version

2019-07-30 23:24:41 -03:00

mockserver.py

Fixes and improvements for DOWNLOADER_CLIENT_TLS_CIPHERS.

2019-08-13 16:56:26 +05:00

pipelines.py

add item_error to be catchable (#3256 )

2018-07-03 16:00:59 -03:00

py3-ignores.txt

Re-enable FTP tests on Python 3

2017-02-27 17:42:00 +01:00

requirements-py2.txt

[MRG+1] Drop py34 support - Update CI envs (#3892 )

2019-08-07 12:36:52 +05:00

requirements-py3.txt

[MRG+1] Drop py34 support - Update CI envs (#3892 )

2019-08-07 12:36:52 +05:00

spiders.py

Move request.cb_kwargs tests to their own test file

2019-06-26 12:31:12 -03:00

test_closespider.py

[MRG+1] Show elapsed time in statscollector (#3638 )

2019-04-07 00:03:40 +05:00

test_command_fetch.py

Let framework handle only HTTP redirects by default for fetch and shell commands

2016-12-07 17:56:13 +01:00

test_command_parse.py

[Tests] Prevent more DeprecationWarnings

2019-07-13 20:23:15 -03:00

test_command_shell.py

Switch from to ` where inline code formatting is desired

2019-03-01 16:56:58 +01:00

test_command_version.py

Fix test

2017-09-25 12:49:27 +02:00

test_commands.py

Fix presentation of template directory in startproject command

2018-08-15 01:35:01 -03:00

test_contracts.py

[test] cb_kwargs contract

2019-08-31 02:44:09 -03:00

test_crawl.py

Move request.cb_kwargs tests to their own test file

2019-06-26 12:31:12 -03:00

test_crawler.py

Deprecation removals for Scrapy 1.7

2019-07-06 13:41:56 +00:00

test_dependencies.py

move tests under root dir

2014-07-30 19:45:08 -03:00

test_downloader_handlers.py

Fixes and improvements for DOWNLOADER_CLIENT_TLS_CIPHERS.

2019-08-13 16:56:26 +05:00

test_downloadermiddleware_ajaxcrawlable.py

PY3 fix AjacCrawlable middleware tests

2015-09-01 03:49:52 +05:00

test_downloadermiddleware_cookies.py

Prevent more DeprecationWarnings

2019-07-13 22:14:00 -03:00

test_downloadermiddleware_decompression.py

PY3 fix test downloadermiddleware decompression

2015-07-29 13:51:01 +00:00

test_downloadermiddleware_defaultheaders.py

Update deprecated test aliases

2017-08-09 12:52:10 +02:00

test_downloadermiddleware_downloadtimeout.py

Update deprecated test aliases

2017-08-09 12:52:10 +02:00

test_downloadermiddleware_httpauth.py

Update deprecated test aliases

2017-08-09 12:52:10 +02:00

test_downloadermiddleware_httpcache.py

HTTP Cache: treat 308 as 301

2017-07-26 19:01:48 +02:00

test_downloadermiddleware_httpcompression.py

Update deprecated test aliases

2017-08-09 12:52:10 +02:00

test_downloadermiddleware_httpproxy.py

Check that spidercls arguments in scrapy.crawler classes are not spider objects

2019-02-12 14:46:27 +01:00

test_downloadermiddleware_redirect.py

Implement the METAREFRESH_IGNORE_TAGS setting

2019-05-08 12:52:29 +02:00

test_downloadermiddleware_retry.py

Improvise the clarity of test cases

2017-03-23 19:45:04 +05:30

test_downloadermiddleware_robotstxt.py

adds ROBOTSTXT_USER_AGENT setting

2019-08-19 09:24:16 +05:30

test_downloadermiddleware_stats.py

PY3 fix DownloaderStats middleware tests

2015-09-01 04:09:15 +05:00

test_downloadermiddleware_useragent.py

Update deprecated test aliases

2017-08-09 12:52:10 +02:00

test_downloadermiddleware.py

removes unused var

2019-06-17 00:06:44 +05:30

test_dupefilters.py

Testing stats and log messages from RFPDupeFilter

2019-01-18 11:39:35 -02:00

test_engine.py

Prevent more DeprecationWarnings

2019-07-13 22:14:00 -03:00

test_exporters.py

[Tests] Monkey patch unittest.TestCase to prevent DeprecationWarning(s)

2019-07-13 19:26:59 -03:00

test_extension_telnet.py

Style changes

2018-09-26 13:28:34 -03:00

test_feedexport.py

Added: Properly handling quoted passwords in FEED_URI for FTP

2019-08-06 15:19:57 +01:00

test_http_cookies.py

Update asserts to use more generic ones

2017-08-09 12:52:10 +02:00

test_http_headers.py

[Tests] Monkey patch unittest.TestCase to prevent DeprecationWarning(s)

2019-07-13 19:26:59 -03:00

test_http_request.py

Fix JSONRequest naming (#3982 )

2019-08-30 11:03:44 +02:00

test_http_response.py

[Tests] Monkey patch unittest.TestCase to prevent DeprecationWarning(s)

2019-07-13 19:26:59 -03:00

test_item.py

Implement Item.deepcopy()

2019-03-22 17:07:10 +01:00

test_link.py

PY3 raise an exception if bytes are passed as url to Link constructor

2015-08-28 23:04:02 +05:00

test_linkextractors_deprecated.py

TST fixed compatibility with new link extractor whitespace handling

2017-02-21 00:05:40 +05:00

test_linkextractors.py

Prevent more DeprecationWarnings

2019-07-13 22:14:00 -03:00

test_loader.py

Prevent more DeprecationWarnings

2019-07-13 22:14:00 -03:00

test_logformatter.py

LogFormatter: Add the ability to skip log messages (#3987 )

2019-09-16 14:12:04 +02:00

test_mail.py

(fixes #2272 ) using arg_to_iter() to wrap single values and list() to avoid consuming from generators.

2016-10-18 11:06:55 -03:00

test_middleware.py

Use collections.deque instead of list to store methods

2018-10-29 12:40:20 -03:00

test_pipeline_crawl.py

TST update tests to use get/getall/attrib instead of extract

2018-09-12 17:57:27 +05:00

test_pipeline_files.py

Disallow media extensions unregistered with IANA (#3954 )

2019-09-16 14:04:06 +02:00

test_pipeline_images.py

Deprecation removals for Scrapy 1.7

2019-07-06 13:41:56 +00:00

test_pipeline_media.py

Fix a memory leak on the Media Pipeline (Files and Images) (#3813 )

2019-06-24 12:38:05 +02:00

test_proxy_connect.py

[MRG+1] Automatic port selection for servicies in unit tests (#3210 )

2018-05-23 21:25:50 +03:00

test_pydispatch_deprecated.py

add deprecation for pydispatch (thanks for the help @redapple)

2016-02-11 16:15:28 -02:00

test_request_cb_kwargs.py

Request.cb_kwargs: update in spider middleware

2019-06-26 12:48:00 -03:00

test_responsetypes.py

Merge pull request #1503 from demelziraptor/amazon-json-response

2016-09-12 13:21:16 -03:00

test_robotstxt_interface.py

Adds integration with Protego robots.txt parser (#3935 )

2019-08-27 09:41:31 +02:00

test_scheduler.py

improve tests and fix some lint warnings (#6 )

2019-03-25 16:08:40 +03:00

test_selector.py

[Tests] Monkey patch unittest.TestCase to prevent DeprecationWarning(s)

2019-07-13 19:26:59 -03:00

test_spider.py

[Tests] Monkey patch unittest.TestCase to prevent DeprecationWarning(s)

2019-07-13 19:26:59 -03:00

test_spidermiddleware_depth.py

Update deprecated test aliases

2017-08-09 12:52:10 +02:00

test_spidermiddleware_httperror.py

[MRG+1] Automatic port selection for servicies in unit tests (#3210 )

2018-05-23 21:25:50 +03:00

test_spidermiddleware_offsite.py

checking for subclass of URLWarning instead of checking error message text when URL in allowed_domains

2017-11-26 20:07:04 +01:00

test_spidermiddleware_output_chain.py

Update docs, add tests, remove FIXME comment

2018-08-03 18:20:25 -03:00

test_spidermiddleware_referer.py

Update deprecated test aliases

2017-08-09 12:52:10 +02:00

test_spidermiddleware_urllength.py

Update deprecated test aliases

2017-08-09 12:52:10 +02:00

test_spidermiddleware.py

Update docs, add tests, remove FIXME comment

2018-08-03 18:20:25 -03:00

test_spiderstate.py

TST remove temporary files and folders

2017-02-16 17:50:38 +05:00

test_squeues.py

Update test for unpickable objects

2018-02-08 15:03:57 -03:00

test_stats.py

enable test_stats and test_utils_log tests in Python 3

2015-08-26 01:58:59 +05:00

test_toplevel.py

drop deprecated "optional_features" set

2015-09-15 09:00:08 +00:00

test_urlparse_monkeypatches.py

Update deprecated test aliases

2017-08-09 12:52:10 +02:00

test_utils_conf.py

backwards → backward (adj.)

2019-03-01 16:10:23 +01:00

test_utils_console.py

Add support for bpython console.

2015-08-21 01:12:58 +01:00

test_utils_curl.py

Create Request from curl command (#3862 )

2019-08-08 09:43:42 +02:00

test_utils_datatypes.py

Suggested changes

2019-07-15 12:37:09 -03:00

test_utils_defer.py

Update deprecated test aliases

2017-08-09 12:52:10 +02:00

test_utils_deprecate.py

Ignore ScrapyDeprecationWarning warnings properly.

2015-06-09 18:22:03 +03:00

test_utils_gz.py

Modifying existing gzip read failure recovery mechanism to patch read for broken archives

2016-08-11 18:21:42 +05:30

test_utils_http.py

move tests under root dir

2014-07-30 19:45:08 -03:00

test_utils_httpobj.py

move tests under root dir

2014-07-30 19:45:08 -03:00

test_utils_iterators.py

DOC address @stummjr's review comments

2018-09-18 05:02:17 +05:00

test_utils_log.py

Fix telnet warnings in tests

2018-07-09 13:44:02 +03:00

test_utils_project.py

Fix test_utils_project under Windows

2018-08-15 01:53:20 -03:00

test_utils_python.py

Add tests for MutableChain

2018-10-11 11:55:13 -03:00

test_utils_reqser.py

Merge remote-tracking branch 'origin/master' into callback_kwargs

2019-06-26 11:03:31 -03:00

test_utils_request.py

Do not fail representing non-http requests

2015-08-10 14:10:58 -03:00

test_utils_response.py

response_status_message should not fail on non-standard HTTP codes

2016-03-12 14:16:40 +01:00

test_utils_serialize.py

Add set serialization to ScrapyJSONEncoder

2016-07-22 17:20:03 -04:00

test_utils_signal.py

Update asserts to use more generic ones

2017-08-09 12:52:10 +02:00

test_utils_sitemap.py

handle relative sitemap urls in robots.txt

2016-12-01 09:53:40 -03:00

test_utils_spider.py

Move scrapy/contrib/spiders to scrapy/spiders

2015-04-29 21:27:19 -03:00

test_utils_template.py

Test utils.template.render_templatefile()

2015-08-26 20:44:33 +03:00

test_utils_trackref.py

PY3: port scrapy.utils.trackref

2015-08-10 15:13:29 -03:00

test_utils_url.py

Prevent more DeprecationWarnings

2019-07-13 22:14:00 -03:00

test_webclient.py

Fixes and improvements for DOWNLOADER_CLIENT_TLS_CIPHERS.

2019-08-13 16:56:26 +05:00