Andrey Rakhmatullin
a138fb05d4
Replace to_native_str calls with to_unicode.
2019-11-14 13:45:39 +05:00
Daniel Graña
ca53a8699a
Fix presentation of template directory in startproject command
2018-08-15 01:35:01 -03:00
Daniel Graña
fb09148c91
Fix bad merge on ParseCommandTest
2018-08-15 01:35:01 -03:00
Daniel Graña
ed8255bde0
Fix merge issues with stderr/out fixes for windows buffering
2018-08-15 01:33:38 -03:00
Jakob de Maeyer
57a1d66c61
Fix test issues caused by Windows pipe buffer filling up
2018-08-15 01:33:38 -03:00
Vostretsov Nikita
72d0899bce
Return non-zero exit code from scrapy commands in case of spider bootstrap errors
...
* method to detect spider creation in crawler
* correct method name
* method to know if crawlers has spiders
* we do not need to issue requests
* set exit code accordingly to spiders in crawlers
* more portable way to check ofr exceptions
* more clear way
* test cases for several spiders per crawler
* grammatically correct name for method
* method is private
* grammatically correct name for method
* method is private
* remove unused import
* correct order of imports
* changes mechanism of obtaining spider status from method to object member
* rename tests
2018-06-14 19:58:48 +05:00
Paul Tremberth
1f08d9a648
Add test for DNS cache disabling
2017-07-04 23:10:19 +02:00
Mikhail Korobov
05b4555f39
TST tests for LOG_SHORT_NAMES
2016-12-09 02:19:51 +05:00
Mikhail Korobov
e46572d6f2
TST end-to-end test for LOG_LEVEL option
...
there were no end-to-end tests for this option
2016-12-09 02:19:33 +05:00
Mikhail Korobov
6eab59cbac
TST cleanup runspider tests
2016-12-09 02:14:12 +05:00
Joakim Uddholm
8c38dde4e8
Moved parse command tests to its own file. Added some checks to check for logged errors.
2016-09-19 05:33:05 +02:00
Paul Tremberth
fbb5559299
Add tests for crawl command non-default cases
2016-09-12 13:35:14 +02:00
Paul Tremberth
ec1c61504a
Merge pull request #2005 from feliperuhland/master
...
[MRG+1] Included new optional parameter in startproject command line
2016-07-19 12:31:06 +02:00
Valdir Stumm Junior
1779f5feca
enable genspider command outside projects
2016-07-06 15:10:48 -03:00
Felipe Ruhland
9ad54b3815
Fix template description after create project
2016-05-24 13:03:33 -03:00
Felipe Ruhland
b8a09d7ab7
Added tests for more or less parameters
2016-05-24 11:58:52 -03:00
Felipe Ruhland
2521f031d6
Created new tests for implementation
2016-05-23 23:15:53 -03:00
Paul Tremberth
104027d78d
Minor change on quotes
...
Trying to force Travis CI to build
2016-02-18 11:45:03 +01:00
Mikhail Korobov
f766dd0ba8
Preserve tracebacks better. Fixes GH-1760.
2016-02-17 23:07:03 +05:00
Mikhail Korobov
06da7af9e2
TST clean up RunSpiderCommandTest
2016-02-17 23:03:12 +05:00
Mikhail Korobov
35ada10729
PY3 enable tests for scrapy parse command
...
scrapy parse command is already ported
2016-01-22 13:39:27 +05:00
Daniel Graña
0f500a1f82
Merge pull request #1708 from scrapy/fix-scrapy-bench
...
PY3 fixed scrapy bench command
2016-01-21 11:51:27 -03:00
Mikhail Korobov
80c55f19a1
PY3 fixed scrapy bench command
2016-01-21 18:31:58 +05:00
palego
6b905a9aec
split-up the assertIn
...
to deal with OS X intricacies (directories prefixed with /private)
2016-01-18 10:18:31 +01:00
palego
c702c53015
change os.mknod() for open()
...
os.mknod() is a privileged command on OS X, making the test fail
2016-01-03 14:33:42 +01:00
palego
2c251000d3
custom project templates
...
allow override of TEMPLATES_DIR for startproject
copy full TEMPLATES_DIR/project tree
doc update
2015-12-01 03:07:27 +01:00
Mikhail Korobov
215905bdb6
PY3 port bench, startproject, genspider, list and runspider commands
2015-10-12 17:59:49 +05:00
Julia Medina
d3f576a816
Move scrapy/spider.py to scrapy/spiders/__init__.py
2015-05-09 04:20:09 -03:00
Julia Medina
1c8708eb82
Create a logger for every Spider and adapt Spider.log to log through it
2015-04-22 17:24:40 -03:00
Julia Medina
7a958f90be
Replace scrapy.log calls for their equivalents in the logging std module
...
Changes:
- Each module takes 'scrapy' logger and logs through it
- Lazy string evaluation in all log messages
- Added missing log messages in scrapy/core/engine.py
- Contextual data such as crawler or spider instances, and failures
2015-04-22 17:24:39 -03:00
Mikhail Korobov
973c31f735
TST cleanup: use assertIn instead of assert_
2015-04-14 20:11:46 +05:00
Mikhail Korobov
39635e5f55
Allow spiders to return dicts. See GH-1064.
2015-03-18 07:26:56 +05:00
Julia Medina
d68615a5af
Test the parse command locally instead of against an external url
2015-01-19 10:28:25 -03:00
Nuno Maximiano
08224c92f4
add project name validation
2014-08-01 14:36:30 -03:00
Daniel Graña
242c08553f
move tests under root dir
2014-07-30 19:45:08 -03:00
