1
0
mirror of https://github.com/scrapy/scrapy.git synced 2025-02-24 10:24:13 +00:00

19 Commits

Author SHA1 Message Date
rhoboro
5254ac393b added test for gcs policy 2018-04-03 18:06:34 +09:00
rhoboro
e5d4364b2a Add tests for GCS Storage 2017-09-13 16:24:16 +09:00
Paul Tremberth
07f9985a94 TST: Randomize FILES_EXPIRES above 90 days 2016-12-21 17:03:11 +01:00
pawelmhm
7d88209543 [image & file pipeline] loading setting for user classes
if user has some custom subclass of Image pipeline and no setting for
this pipeline, he should get default settings defined for Image Pipeline.

Fixes #2198
2016-09-15 09:39:16 +02:00
Pawel Miech
fa4d0cdfe5 [FilesPipeline, ImagesPipeline] fix for cls attrs with DEFAULT prefix
some class attributes for ImagePipeline and FilesPipeline had DEFAULT prefix. These
attributes should be preserved as well, if users subclasses define values for
DEFAULT_<CLS_ATTRIBUTE_NAME> attribute this value should be preserved.
2016-06-20 12:53:20 +02:00
Pawel Miech
539d34bce0 [media-pipeline, file-pipeline] allow setting custom settings for subclasses
* move key_for_pipe function to media pipeline so that file pipeline can use it
* use key_for_pipe in file pipeline so that users can define custom settings for subclasses easily
* add tests for file pipelines attributes and settings
2016-06-15 15:39:11 +02:00
Pawel Miech
acbfdc6184 [files_pipeline] ensure class attributes are preserved
dont override class attributes with default settings (same as in image pipeline).
2016-06-15 15:14:28 +02:00
Pawel Miech
c6d1686d98 [files_pipeline] unify tests for files pipeline
if test tests same thing but for different field it can be unified into one.
2016-06-15 14:48:25 +02:00
djunzu
8228a0c491 Change FilesPipeline class attributes to instance attributes.
modified:   scrapy/pipelines/files.py
	modified:   tests/test_pipeline_files.py
2016-03-31 19:20:39 -03:00
djunzu
e9d48f8a8e Add tests.
modified:   tests/test_pipeline_files.py
	modified:   tests/test_pipeline_images.py
2016-03-31 19:19:49 -03:00
Konstantin Lopuhin
d61fbcc8b5 Support headers in S3FilesStore.persist_file for botocore 2016-02-18 10:57:02 +03:00
Konstantin Lopuhin
3cb7a567ea py3 fix for TestS3FilesStore: checksum is a native string 2016-02-15 19:59:48 +03:00
Konstantin Lopuhin
32cd8c9165 add direct test for S3FilesStore 2016-02-15 19:59:48 +03:00
nyov
991197003b PY3 fix tests pipelines files 2015-08-08 04:22:58 +05:00
nyov
ec8afbc060 PY3 fix test pipeline media 2015-07-29 13:51:01 +00:00
Julia Medina
8021df18d4 Move scrapy/contrib/pipeline to scrapy/pipelines 2015-04-29 21:26:35 -03:00
Mikhail Korobov
39635e5f55 Allow spiders to return dicts. See GH-1064. 2015-03-18 07:26:56 +05:00
Berker Peksag
31e5f164d4 Import unittest.mock if available.
mock is in the stdlib since Python 3.3.
2015-03-08 15:03:04 +02:00
Daniel Graña
242c08553f move tests under root dir 2014-07-30 19:45:08 -03:00